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ABSTBACT 

A critical examination of some basic claims and 
issues associated with needs assessment is presented. This paper 
identifies the various meanings and methods associated with needs 
assessment, including some of the evidence concerning differences in 
actual practice. Issues which arise as a result of various approaches 
to needs assessment are discussed, and practical guidance concerning 
whether or not to conduct a needs assessment is offered- Highlighted 
are: the meaning of the term: federal law and regulation; proposed 
methods, tools, and concepts for conducting needs assessment: and the 
reasons for and uses made of the needs assessment. Although current 
literature is generally optimistic about the value of needs 
assessment for resource allocation and decision-making in public 
agencies, this paper presents a clear contrast. It is concluded that 
the case for, limits of, and evidence about the positive impact of 
needs assessment are not encouraging. Caution and circumspection are 
suggested about the likely analytical contribution which assessments 
might make to decision-making in public agencies. (Author/GSK) 
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FOREWORD 



This is the third in a series of papers on the subject of "needs 
assessment- which my office has sponsored under the direction of 
Walton Francis. The first two papers, Needs Assessment: An Explor - 
3^9!iy Critique, and A_COT£endium of La^_ai^_Re2ulationsJRe^ 
Needs ~Assessment , were"published last" spring"^ *Ail of these papers 
are part of a continuing effort to inprove human services planning. 

This effort is especially important and timely in the light of 
President Carter's July, Vi'il requirement for a zero-based review 
of all Federal planning requirements related to Federal financial 
assistance. The President said, -Planning is a vital part of making 
any decision. State and local governments, however r have been 
plagued by too much of a good thing." Unfortunately, one of the 
principal causes of this burden is the widespread belief, mandated 
upon States in dozens of HEW regulations, that ''needs assessment' 
is the first and most important step in planning for resource allocat- 
ion. The findings of this paper, and of the previous papers, cast 
considerable doubt on the validity of such claims and, indeed, 
on the usefulness for any purpose of "needs assessment" as conroonly 
perceived and conducted. 

We view our effort as the initiation of a dialogue with both practi- 
tioners and theoreticians, and welcome conments and suggestions on 
the problem, on our papers, and on steps which the Department or 
others might usefully take. Conments and requests for copies of 
our papers should be sent to the address below. 

uir thanks to Wayne Kimmel for ably diagnosing the underlying premises 
and specific problems of "needs assessment" as faced by State and 
local practitioners. If the problems are understood and faced r then 
we believe that studies and analyses well targeted to actual decision 
problems can replace unnecessary and invalid surveys of "need", and 
provide a real contribution to better planning of social programs. 




Deputy /assistant Secretary 

for Program Systans 
Office of Planning and Evaluation 
Hubert H. Humphrey Building, Ion. 447-D 
200 Independence Avenue, S. W. 
Washington, D. C. 20201 
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FREB'ACL 



This paper presents a critical exariiination of some of the basic claims 
anol issues associated with activities called "neeas assessme./.:." It has 
been prepared for those interested in the subject because the phrase has 
come into vogue in the past f«w years or because they are faced with a 
decision about whether or not to undertake a formal assessment. This is 
not a cookbook or manual on how- to-do needs assessment. Many of these 
already exist (See Sources). Instead, the paper iaentifies the many 
meanings and methods referred to by the phrase "needs assessment" and 
recites some of the spotty evidence about what difference it might make in 
actual practice. It also identifies issues which arise as attenpts are 
meuie to use various approaches to needs assessment to influence the allocat- 
ion of public resources. Finally, it attempts to provide some practical 
guidance about whether or not to conduct a needs assessment. 

'ine paper has a siirple prenise: needs assessment will cost ar agency 
money r time and energy and should have a reasonable payoff, in the case 
of large statewide surveys, for example, assessments are likely to cost 
hundreds of thousands of dollars, require several person-years of effort 
and take months if not years to complete. Even on a small scale, needs 
assessments consume scarce resources. Like any other expenditure of public 
funds, this one ought to meet a basic and prudent test of reasonable payoff: 
will needs assessment be worth the candle? Like many other approaches and 
methods which are offered to ease the difficulty and conplexity of public 
choice, the methods of needs assessment tend to overshaoow their purposes, 
uses and potential effectiveness. 
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k juagment alx.>ut whether to do an assessment or one about which 
c^proaches to enploy ought to be informed by a minimum understanding of 
what, how and why. If officials are not convinced of the likely relevance, 
significance and utility of a proposed assessment, why do it? Public funds 
may be better spent on more promising purposes, not the least of which is 
the provision of services to the m^ny we already know are in "need." 

The bulk of the current literature is optimistic about the value of 
needs assessment for resource allocation decision^rtiaking in public agencies. 
By contrast, this paper concludes that the case for. limits of and evidence 
about the positive inpact of needs assessments are not encouraging. It 
suggests caution and circumspection about the likely a nalyti cal contribution 
which assessments might make to decision-making in public agencies . It reninds 
us that human needs are infinite and that need satisfaction is not free. 

In preparing this paper we have drawn generously on the heterogeneous 
writing on needs assessment in the belief that the literature should speak 
for itself. We have also taken at face value the coninon claim that needs 
assessment is intended as an analytic aid to public choice. That claim is 
discussed extensively. Readers who want a sumnary listing of conclusions 
should turn to Part IX - Recapitulation. 
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I. INTRODUCTION: THE PROBLEM 



Federal requirements for an assessment of "need" to be met by progranis 
began to appear in legislation in the mid-sixties. By the early to mid- 
seventies the frequency of these requirements seemed to have increased. 
By now, presumably thousands of "needs assessments" have been created in 
response to federal requirements. With the growth in the number and 
potential cost of needs assessments, however, their methods and utility 
began to draw attention and critical scrutiny. Questions have been raised 
about what is going on under the rubric "needs assessment" and critical 
conmentary and articles have begun to appear. Commenting on "problems 
and deficiencies in the needs assessment process", for example, Shapek 
(1975) observed: 

A host of federally funded studies have assisted state 
and local officials in creating priority listings of 
needs. The supposition is that once these listings have 
been created, such ordering will permit decision makers 
to plan and manage resources and programs more effec- 
tively as well as to formulate more significant, long- 
range policy initiatives. Unfortunately, there is little 
evidence that this occurs. Needs listings are largely 
ignored and ridiculed (p, 754). 

In a recent attempt to locate basic materials on needs assessment, Varenais 
(1977) sanpled the available literature. She concluded that the writing on 
the subject constitutes "a semantic jungle," that definitions are vague, 
and that discussions of th- subject are "confused." Commenting on a pre- 
occupation of the literature with methods rather than results, she concluded: 

Many sources suggest intricate sets of activities to produce 
information, but omit satisfactory explanations of what these 
processes are directed toward or how the data would be used (p. ii). 

Similarly, a recent examination (Zangwill, 1977) of a large collection of 

HEW statutes and regulations which call for needs assessment concluded: 

....it is clear that the Department, in its official instructions 
to recipients of its funds, provides no clear conception of the 
what, why and how of needs assessment" (p. 5). 

o 1 . 

ERIC lf> 



After noting that resource allocation decision making in public agencies 

is conplex and based on the political and value-laden competition of inter 

ested parties for scarce resources, a federal official recently cautioned 

national conference on needs assessment: 

I don't think we ought to he lulled by the fact that data 
and needs assessment are going to give us our priorities 
and our choices (Peterson, 1976, p. 27). 

What is the criticism and doubt about? What is needs assessment? Why 

should it be done? What good will it do? The remainder of this paper 

attempts preliminary answers to these questions. 



11. FLDEKAL RLQUIREMENTS FOR NLEDS ASSESSMEI>1T 



A. Laws angjveaulatlors: Since the mid-sixties the amount of feoeral 
legislation which includes references to or requirements tor "needs assess- 
ment' has grown, m assessment, or eviaence that one was conaucted, is 
often required as part of a planning process, a component of a plan, or a 
precondition for grant support, nelatively prominent prograir,s which require 
a needs assessment include Vocational Education, Social Services (Title XX of 
the Social Security Act), nealth Planning and Resources Development, Community 
Mental health Centers, and Aging programs. 

Provoked by the spread of wnat appearea to be a vague, amoiguous ana 
potentially expensive set of requirements, the Office of the Assistant 
secretary for Hanninq and evaluation conauctea a broaa but partial examina- 
tion of the laws and regulations of hhW programs which contain a need assess- 
ment reference or requirement (Zangwiil, 1^77). Ihe report of that examination 
includes tfjese conclusions: 

o MA is required in 2b of the largest hhvv grant- in-aia programs. 
Several programs fund projects whose main purpose is to conduct MA. 

o In about half the cases, the law clearly requires IvlA; in the other 

cases the regulation, by HEW discretion only, mandates the requirement. 

o The results of the iviA are almost always part of the material sub- 
mitted to Eeaeral officials as a precondition for obtaining a grant, 
usually in the btate plan (tor formula grant proqran.s) or application 
(for project grant programs). Thus, nA is viewed by the writers of 
legislation ana regulations as an integral part or the planning process, 
certainly of sufficient importance to be reviewea at the Federal level 
prior to awaraing program funds. 

o The responsibility tor conaucting NA falls on the direct recipient of 
Federal funas: in tormula programs the State usually conaucts \su\', in 
project programs the applicant, often either a local or state govern- 
ment agency » does the assessment. 

o Despite tne presumptive importance of imA, the statutes and regulations 
never define "need" or "needs assessment" and in only two cases specify 
a frequency for assessing neeos. Furthermore, most of the programs 
state no tecimique at all for conaucting an ImA while the remaining 
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five or tei^ are unclear on this matter or give only partial quiaance 
in collecting the data. Moreover, no programs supply clear direc- 
tions on how to use inlormation once it is collected. (However, 
some of these programs do have informal guidelines which suggest 
some techniques.) 

o i>iA is mo3t often intended as a means ot resource allocation, that 
is, as a supposed means ot directing services to those persons or 
areas havrg the greatest umiiet "need" or of previa inq those par- 
ticular services for which "need" is greatest. Anothor type of 
resources allocation requirement occurs in education programs requir- 
ing equitable participation by children attending private schools. 
In these situations, imA is often usf?d to determine that these chil- 
ren receive services comparable (again, according to a standard of 
"neeas* ) to those received by their public school counterparts. 

o Uo clear differences can be ascertained between programs requiring 
tih ana those without such a requirement.... 

o Thus, while NA requirements play a major role in the Federal grant- 
in-aid mecnanism, the requirements are very poorly aetinea. A grantee 
could easily follow the formal requirements without using the results 
to design or improve its own program. It tnis situation is cononon 
hbW could eliminate regulation-required wA altogether in the many 
programs without clear requirements in their legislation. On the 
other hand, if the Department believes NA is useful, it could provide 
clear directions ana/or technical assistance to enable grantees to 
make it a meaningful part of their program planning. Following either 
course would improve the present situation, in which it is clear 
that t±'e Department, in its official instructions to recipients of 
its funds, provides no clear conception oi the what, why and how 
of needs assessment (Zangwill, pp. 4-6). 

A major ano detailed table contained in the HLW stuay descrioes the scope oi 
assessment requirements: 

o of 3b prograrii authorities, lb clearly require a need assessment, 
y do not and the rest are unclear. 

o 'Ihough a requirement may be absent in a given law, ^3 sets of 
regulations clearly require a need assessment. 

o lb programs require a need assessment in a plan, ib m an applica- 
tion for grant support. 

0 11 programs require that the state conduct the assessment, lb a 
locality, and 9 either a state or locality or both. 

o wo method or approach appears in 23 of tne programs, while b 
suggest a "partial" approach. 

o Mot a single program defines need assessirent. 
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B, Why Does the Federal Governnient Require- ?Jey^s Assessnient ? The 
answers to this question are probably as mixed and variable as the motives 
and interests of the individuals and groups who initiated, participated in 
or promoted the requirements in the first place. Though we cannot trace 
the 10-12 year federal history of needs assessment requirements, discussions 
with a variety of federal officials yield a mosaic of opinions and inter- 
pretations which can be characterized this way: 

1. Assessing need is a natural first step in planning . If you do not 
know "what the need is", so the argument goes, how can you figure out what 

to do? According to this view the rationale for need assessment is apparently 
self-evident. The intended function appears to be basically analytical. 

2. Needs assessment will presumably contribute significantly to a broad 
range of other useful activities including planning, priority setting, evalua- 
tion, resource allocation, decision making, and policy formation. Like the first 
rationale, this one poses needs assessment as a rational, analytical tool. 

3. The focus on "need" is basically a response to increasing pressure 
over the past ten years for cost reduction, accountability and demands for 
justification (frequently of an economic and quantitative variety) of many 
existing and new public programs. According to this view, the increasing 
demands for economic justification provoked program advocates and officials 
to respond by sponsoring or conducting studies of their own. Needs assess- 
nients are used to "justify" the existence and proposed growth of programs by 
underscoring that "need" does in fact exist and that it is frequently far 
greater than the coverage of existing services. This rationale suggests 
that assessments are inspired for advocacy purposes. It also implies that 
they are sometimes an attempt to "fight fire with fire," studies with studies, 
"cost" data with "need" data. 



4. Needs assessment is *Dasically a reflection of the desire ot 
social scientists (other than economists who do not use the term "need") 
to use their tools to participate in social program planning. Rightly or 
not the fiela of psychology is usually iaentified as the likely professional 
source of the concept "need." Abraham Maslow's humanistic psychology is 
basea on a theoretical notion ot a "hierarchy of human needs' and is fre- 
quently referenced when this rationale is offered. In addition, the needs 
assessment literature frequenUy urges the use of formal surveys as the pre- 
ferred method. Survey researchers sometimes have a background in psychology 
or opinion research. In this view, support for needs assessment is support 
for some academic disciplines and their techniques. 

5. Meeds assessment is another reflection of the common but mis- 
guided call for "more data for decisions." According to this interpretation, 
technocrats with a bent for numbers are responsible for the promotion of 
needs assessment. "More data" is a commonplace knee jerk response to per- 
plexing problems of public policy whicn are poorly understooa. Data is 
assumed to clarify understanding. 

fa. Needs assessment is an additional tool of 'participatory democracy." 
It is a way to "by-pass" bureaucrats by "going directly to the people" to ask 
them what they need and want. According to this interpretation its primary 
purpose is not analytical but political. It is purportedly a way to gather 
information "directly from citizens and provide it 'directly to decision 
makers. 

7. In a final alternative rendering of a rationale for the growth of 
needs assessment the trend is characterized as a new fad, even a new 



ideology. Several participants in a recent conference alluded to the needs 
assessment "movement." 

There are no means to weigh the alternative proposed rationales for the 
growth of federal need assessment requirements. The explanations have, how- 
ever, all been tendered by thoughtful individuals some of whom were involved 
in the actual formulation of need assessment requirements. Most, if not all 
of these alternative rationales also appear in the proceedings of a recent 
conference on "Need Assessment in Health and Human Services" (Bell, et al. 
197b). Like most oth^ trends which draw wide attention and varied 
adherents and spokesmen, t^is one is probably actuated by a broad range of 
motives and intents. 
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III. VIEWS AND CIAIMS 



Alte r native Vie ws of Needs A ssess ment! The literature contains 
many varied views of needs assessment. It appears that needs assessment 
can be almost anything: a change-oriented process , a me^od for enumeration 
and description, an analytical procedure , a dec is ion-mak ing process, a process 
for the "resolution of many viewpoints," etc. If there exists an underlying 
conception of "need" it is rarely explicit and never specific. The literature 
speaks for itself: 

1. bowers and A s sociates (undated): 'All community education programs 
use, or have used at one time, a needs assessment to determine the content 
of their program." It is a process for 'identifying needs, setting objectives, 
setting priorities, and relating them to the community education program on a 
continuing basis." 

2' ggpter for Social Research and Develo pment (1974): "Needs assessment 
is a change oriented process, whereas resource allocation is a political process. 
Social planning and resource allocation should be responsive to problems and 
needs of the population.. ..these needs should be ascertained through an objec- 
tive process... .Needs assessment deals with the attempt to define what is re- 
quired to insure that a population is able to function at an acceptable level 
in various dona ins of living." 

3. Florida Department of Hea lth and Rehabilit ative Services (1975): 
•'Needs assessment can most sinply be defined as a method which enumerates 
and describes the needs of people living in a community." 

4. Human Services Institute (1975): Needs assessment is the process 

which consists of "a resolution of many viewpoints as to which are the state's 

high priority or urgent needs." "Needs assessment is closely related to goal 

and objective setting in that needs data provide a measure of demand for 

services against which the service goals and objectives should be set." 

8 
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5. Harnr^ aves, et al (1974): "Basically, mental health assessment is 
an attenpt to describe and to understand the mental health needs in a geo- 
graphic or social area. This involves two distinct steps: (a) the applica- 
tion of a measuring tool or assortment of tools to a defined social area? 
and, following this attempt at measurement, (b) the application of judgment 
to assess the significance of the information gathered in order to determine 
priorities for program planning and service development (Blum, in press)." 

6. Minnesota State Plcuining Agency (1977): Of two proposed definitions 
the Planning Agency discusses this one: "Needs assessment is the process of 
identifying the incidence, prevalence and nature of certain conditions within 
a coninunity or target group. The ultimate purpose is to assess the adequacy 
of existing services and resources in addressing those conditions. The ex- 
tent to which those conditions are not adequately addressed denotes a need 
for new or different services or resources." 

B. Claims for Needs Assessment are Ambitious : LiKe views of the pur- 
poses of needs assessment, the claims for it are broad and ambitious. Here 
are four illustrations: 

o A manual prepared by the Booz, Allen consulting firm (1973) for 

use in the social service area lists 11 purported purposes or uses 
for needs assessment. The list includes such highly diversified 
and ambitious claims as: "A tool for community planning.... 
a basis for establishing priorities and setting realistic objec- 
tives.... use in the organization and development of staff.... an 
operational tool for use by service workers in information ar^ 

referral a staff education tool a justification and sut>- 

stantiation of legislative program budget requests. .. .an input to 
a client information system. .. .etc. " 

o Warheit, et al (undated), authors of a federally funded and widely 
referenced manual, claim that "need assessment programs are in- 
tended to provide data on the basis of which agencies will be able: 
(1) to identify the extent and kinds of needs there are m a com- 
munity; (2) to evaluate systematically their existing programs; and 
(3) to plan new ones in the light of the communicy's needs and 
mental health service patterns." 
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Tne autiiors list five potential uses of neeas assessment: "1. pro- 
vides data regarding the needs and services patterns of specific 
populations and sociodeinograpluc groups in the community, (k) pro- 
vides data for comparative analysis of the goals, activities and 
client patterns of human service agencies with the needs and ser- 
vice patterns of those in the community. (3). Provides data for 
the development and modification of agency based programs designed 
to meet specific needs within various groups in the community. 
{<»). irrovides oata for the generation of evaluation-outcome and 
impact studies, (b). Provides management information data for 
administrative purposes.'- (Unoatea, circa ly75) 

o Siegel (1974): "Assessment is a part of mental health planning. 
It provides one important informational input to a much broader 
planning process which leads to (a) a mental health plan; (b) the 
selection and operational izat ion of specific program activities; 
and (c) the evaluation of these program activities. A thorough 
assessment is essential to place mental health problems and ser- 
vice needs in some perspective. It helps assure that there will 
be aaditional inputs to staff formulations of service needs and/or 
to the most vocal or powerful community group's opinion in service 
development. Assessment is useful in established programs as a 
part of a periodic examination of the relevance of existing ser- 
vice programs to changing mental health needs ana priorities in 
given communities" (pp. 7-b). 

o Sciieff (iy76): -Finally, 1 cannot resist as a planner interested 
in aeveloping appropriate methodologies, reminding myself, and 
perhaps this audience, that neeas assessment must be seen not only 
as a method but an end in itsglt. '• (Underlining added.) 

li one were to believe the maiiy and ambitious claims, needs assessment 

is good for planning, evaluation, priority setting, resource allocation 

ana for many otlier purposes. 

^' i''h^^.y9^^^P^^J^^.^^^^^^^±^^:_t^^^B' ^ince there are so many federal 
requirements and so many claims for needs assessment, one might conclude 
that this straigntforward question has a simple answer. It does not. Fea- 
eral laws ano regulations are of little help. Because the meaning of needs 
assessment is so vague ana variable, one recent stuaent referred to it as a 
"semantic jungle" and recommended that the phrase "be struck" from the human 
services vocabulary (Varenais, 1977;. m fact, no small part ot the confusion 
and vagueness about "needs assessment" springs from the very words themselves. 




Ot the two woras, 'assessment is the least troublesome. Leaving asiae 
tiie tax related meanings of the term, the dictionary indicates that "assess* 
means "to evaluate; appraise - See bynonyitis at estimate.' Assessment, then, 
means the act of evaluating, appraising or estimating, however common it 
may be. the concept "needs" is more trouolesome. A large share ot the literature 
does not even bother to discuss or attempt to define the word. The meaning 
is assumea to be clear and obvious. After all. we ^11 have needs. 

unfortunately, "neeo" is a wora with variable meaning because it aoes 
not have a specific referent. It aoes not refer to something in particular 
but rather to something^wjucj^o The dictionary makes this 

clear : 

Neea. 1. A condition or situation in which something 
necessary or desirable is required or wan tea; corps in 
need of water. 2. A wish for something that is lacking 
or desired; a need for affection. 3. Necessity; obli- 
gation: There is a need for you to go. 4. something 
required or wanted; a requisi"2; Our needs are modest, 
b A condition of poverty or misfortune: He is in aire 

n4ed synonyms: need, necessity, exigency, requisite. 

(New College Eaition, The American heritage Dictionary 
of the English Language, 15^76; p. &7b). 

One of the few definitions found in the literature is consistent with the 
open-endea character of the dictionary meaning ot neeu: 

A human neea is any identifiable condition which limits 
a person as an inaividual or a family member in meeting 
his or her full potential. .. .which is usually expressea 
in social, economic or health-related terms and are fre- 
quently qualitative statements, (human Services Insti- 
tute, 1975) 

In short, :nee<r^is basica^^^^^ oi^e without concegtual.boun^ 

the, term J.s_to_haye_operatl^^^ 
context ,_us_ual ly^by Jhe^use^ of _absoluJte or . r elat iye J compar a t iye ) cr i ter ia 

or standards. 
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If we combine the basic meanings of the two words "need" and "assess- 
ment" we have this rough but open ended definition of needs assessment: 

Act of estimating, evaluating or appraising a condition 
in which something necessary or desirable is required 
or wanted, 

A needs assessment "guide" prepared by the Minnesota State Planning Agency 
(1977) makes the same basic point: 

...needs assessment involves more than the collection 
and analysis of data - it is a process of interpreting 
social conditions in light of society's beliefs, values, 
and sense of public responsibility. The benchmarks that 
distinguish between need and lack of need are as depen- 
dent upon human nature as they are upon the quantitative 
indicators generated by sophisticated research techni- 
ques. Need is a relative concept . There are no objec- 
tive standards for determining whether a need exists or 
does not exist, (p. 10) 

In this relative meaning of "need" we have one of the major keys to the 

confusion about needs assessment. Needs do not show theirselves. Someone 

must establish what constitutes a need. The needs assessment literature 

implies that in practice needs will not only show themselves but will also 

show their relative inportance (priority). The relative character of "need" 

is reflected in the fluctuating and debated nature of that widely cited global 

measure of need, the so-called "poverty line". A recent HEW report noted that: 

Measures of poverty used for national policy purposes 
require fundamental social, political and ethical 

judgments The official measure of poverty has 

a number of limitations, some of which stem from the 
fact that there ar e no commonly accepted standards of 
need, other than Tlvr food . (U.S. DHEW, April 1977, 
p. xxi', underlining added.) 

When we speak of need(s) in a human resources context we often think 

of basic human needs, subsistence needs, survival needs. The word rapidly 

becomes suffused with emotion, feeling, urgency and passion. It also be- 
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comes loaded with cultural, normative, philosophical and political overtones 
Because it is both emotion-laden and value-loaded, "need" is subject to many 
shades of meaning, intent and interpretation. The emotive and mercurial 
attributes of the word "need" follow the term into activities called "needs 
assessment. " 
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IV. APPROACHLS TO NEEDS ASSESSMENT' 



A* li}Sre isj^S ingle or jtref err eci_ Abroach: ihose who are looking 
for a single or preferred approach to needs assessment will be disappointed. 
A sampling of the literature indicates tnat proposed approaches and methods 
are many, heterogeneous and without practical or conceptual links or unify- 
ing logic. 

In a preface to their attempts to invent neeos assessment methods for 
the Community Services Administration of HEW, the firm of Booz, Allen noted 
that one reason for their work was that "the state of the art of needs and 
resources assessment was not generally well developed," In a recitation ot 
t^ie advantages and aisaavantages of a range of needs assessment approaches, 
hargreaves, et al (1974) acknowledges that there are no preferred methods: 
•Although we will present each technique separately, the most fruitful 
assessment efforts represent combinations of various strategies. Utie state 
of the art is such that there is no single, universally agreed upon approach 
to roenUl health needs assessment. " (Any other program could be substituted 
for "mental health".) m the preface to their sober but obviously frustrat- 
ing attempt to survey the "state of the art" of needs assessment, the Center 
tor Social Research and Development in Denver (1974) is apologetic to the 
reader: "Unfortunately the confusion and ambiguity found in the field of 
needs assessment research is reflected in this report." 

The table on the next page lists the several methods which have been 
suggested for needs assessment, other methods or a^Jroaches could probably 
be added. 
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ALTERNATIVE APPROACHES TO NEEDS 
ASSESSMENT IDENTIFIED IN THE LITEBATUBE 



I. Gathering Opinions and Judgments: 

A. Key Informants (Knowledgeable individuals and experts) 

B. Coninunity Forums (Discussion meetings of any set of coitmiunity 
meinbers) 

C. Public Hearings (V«ith any set of lay or expert witnesses) 

D. Connainity and Political Leaders 

E. Group Processes (e.g., a semi-structured process such as the 
nominal group method) 

II. Collecting Service Statistics: 

A. Utilization data and rates 

S. Caseload and workload data 

C. Grievance and conplaint data 

0, wait-list data 

E. Service data in existing Management information Systems 

III. Epidemiological Studies (Systematic studies of the origins of problems » 
especially health problems) 

IV. Studies of the Incidence and prevalence of Problems (e.g., of disease 
or handicapping conditions or defects) 

V. Social Indicators - Use of quantitative measures of variables, e.g., 
unenployment, crime, schooling, income, prices, housing, etc. 
NOfl'E: "Indicators" can be derived from descriptive sociodemographic 
data like census data. 

IV. Surveys: 

A. Formal general population sample survey (these may be conducted 
through direct, telephone or mail questionnaire) 

B. Formal subpopulation sample survey (e.g., of a locality, an age 
group or a service population) 

C. Selective special interviews with service clients, providers, 
practitioners, agency officials, etc. 

VII. Secondary Analysis of Existing Studies or Sets of Organized Data 
VIII, Combinations of the Above 
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It is not the purpobe of this paper to describe or critically evaluate the 
individual approaches listed in the table. That has been done elsewhere 
(e.g., see Francis (1973) and Schneider (1976) on the limitations of social 
indicators and the Conference Proceedings (Bellr 1976) mentioned earlier for 
a critique of a nuinber of the others). There are., however, several observa- 
tions worth making about the set of approaches and methods. 

First, none of them is new. They are all bo rrowed for use in needs 
assessment. Most are traditional approaches which have been employea by 
public agencies for years: experts (key informants), community meetings 
(forums), public hearings, community and political leaders, workload, 
grievance, conplaint and utilization data. One, social indicators, is "new" 
within the past 10 years, though indicators like unemployment rates, con- 
sumer prices and inflation rates have been used for decades. The so-called 
"nominal group process" method for getting convergent results out of group 
discussions is of recent vintage, but deriving group choice or preference 
tnrough aiscussion and voting has been going on tor thousands of years. 

Second, with perhaps the exception of epidemiological research studies, 
ail the approaches are ways to collect data or opinions. None has a well 
developed set of analytics, models or theoretical procedures associated with 
it beyond standard statistical procedures which exist for manipulating data. 
The approaches do not include guides for data interpretation and analysis 
in the context of resource allocation or priority-setting. 

Third, all the methods except epidemiological research and the use 
ot experts are sources of aescriptions of needs and not explanations of why 
and how they arise or what could be done about them. 
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Fourth, there do not exist systematic procedures for relating data from 
one approach or method to the next. There is no method for synthesis. 

Fifth, beyond the Roman Numeral classification into which we have 
arbitrarily cast them, there is nothing unifying or common about the approaches 
^rt from the fact that they represent alternative ways to gather data, 
opinions and judgments. 

Sixth, it is a coirmonplace observation in the literature that single 
aK>roaches to ne Is assessment will not do, because they are all limited. 
Most advocates claim that multiple approaches must be employed, presumably 
in the belief that the weaknesses of one method will be cancelled out by the 
strengths of the next. 

Seventh, in terms of their logical distance from those "in need" the 
set of approaches include at least three types: 

1. Approaches for direct queries of individuals which include surveys 
and interviews of existing and potential clients. 

2. Approaches for direct queries which include the use of experts, 
informants and knowledgeable individuals who are reporting on the perceived 
needs of others. 

3. Indirect approaches from which inferences must be made about needs 
which include the use of sociodemographic data sources and derived social 
indicators. 

All the methods require inferences from descriptive statements of need 
to the "c .3es" or sources of those needs. Dealing with needs appears to be 
like dealing with symptoms of problems rather than with their underlying 
"causes." Finally, none of these proposed approaches constitutes a way of 
"assessment" of needs. At best, the approaches lead to descriptive state- 
ments of needs but none of them provides a way to "assess" them . How does 
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the assessment (valuing and weighing) of needs occur? Are we thrown back to 
the political process which neeas assessment Is intended to inprove? Or to 
experts? or to advocates? It appears that the proposed methods are not needs 
€§?^.?§I?§P^ methods at all, but needs description methods at best. One observer 
has argueH that the proponents of needs assessment got off on the wrong foot 
when they tried to give the activity the appearance of an "analytic technique" 
when it is not. 

^' '^^^..^^^^^i^^9L.^^^.t^§P^^mnti Lvery major methoa and approacn to 

"improving" organizational performance focuses on, emphasizes or accents some 

aspects of an organization's behavior, structure, functions or processes (see, 

for example, Kimmel et al 1974). Management By Objectives, for example, 

focuses on internal short-range management goal and objective setting. 

It is intended to induce joint objective setting between superiors and 

subordinates and thereby increase communication between them. i'ERT is 

intended to improve an organization's capacity tor defining and relating 

tasks, for work scheduling ana for determining optimal or critical paths 

through complex interrelated activities by estimating and comparing their 

cost ana time requirements. Organizational Development {Ob) is intended 

to improve organizational performance by inproving enployee selfconsci jness 

and interpersonal relations. 

Wnen it is not silent on its purposes the literature states tnat needs 

assessment is intended to improve an agency's capacity for planning, priority 

setting and resource allocation decision making Another, but broader, approach 

directed to the same types of inprovements is the Hanning-Programming-Budget- 

ing (FPB) approach introduced to the Feaeral government in the mid-sixties. 

Because they are billed as similar in intended purposes, a brief comparison 

of the two approaches will help define the dominant features and limits of 
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needs assessment. The table on the next pages selectively compares the 



two af^roaches and suggests these contrasts: 

o The m ajor conc eptual gr^philpsopjncaLsQ ^® 
fields of economics (primarily micro-economics), decision-theory 
and theories of public or collective choice. There are no clear 
conceptual sources for needs assessment. The summary of the 
national conference proceedings identified earlier (Bell, 1976) 
makes the point plainly: 

Needs assessment has risen from opportunistic and 
eiipirical sources. It is not 'owned' by any one 
discipline. As a result, it has no unique theoreti- 
cal frameworks. Also, perhaps as a result of its 
'odd' birth, it is not well grounded in either a 
theoretical literature or in research findings. 
There is missing the scholarly first step of finding 
out what went before (p. 316). 

o The m ajor co ncepts of fPB include a heavy emphasis on (a) cost 
and budgetary constraints and on the relationship between the 
expenditure of resources (input) to the production of services 
(output); (b) the development and evaluation of alternative pro- 
gram and policy actions in terms of their cost, efiiciency and 
effectiveness ; and (c) the importance of time reflected both in 
a multi-year time horizon for planning and in a concern for 
estimating the effects of future uncertainty on the cost ana 
feasibility of alternative courses of action. 

By contrast, the concepts of needs assessment probably came 
from psychology and social casework. There is little if any 
attention paid by the needs assessment literature to the cost and 
budgetary constraints on choice. Emphasis is on the consideration 
of a broad spectrum of unconstrained needs as they are articulated 
by individuals, experts and leaders or inferred from data. The 
focus is clearly on increasing the amount of detail (descriptive) 
about the conditions, defects and -unsatisfied needs*' of indivi- 
uals and groups, whereas PPB carried with it techniques for 
gauging price, cost and benefits, needs assessment is preoccupied 
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NEEDS ASS£SSME^a' AND PPB COMPAKED 



NEEDS ASSESSMENT' 



I. MAJOR CONCEWUAL SOURCE Eclectic and unclear (may be psychology, 

survey research) 



II. MAJOR ANALYTICAL lOOLS None 



III. MAJOR LATA SOURCES 



O 



Canvasing opinions and judgements (ex- 
perts and corranunity groups) 
Field Surveys 
Social Indicators 
Donographic Indicators 
Epidemiological Studies 
Incidence anC Prevalence Studies 
Secondary Data Analysis 



IV. MAJOR CONCEPTS 



Needs: 
Individual 
Community 
Met 
Unmet 



Assessment (Not operationally defined): 
Estimating 
Valuing 
Judging 



2 J Identifying Gaps: 

Described needs juxtaposed to 
existing resources (services) 
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PLANNING-PRDGRAMNilNG-BUDGETING 



M icr o-econom ics 
Decision Theory 

Public (collective) Choice Ttieory 

Program Budget 

Program and Financial Plan 

Analytic Studies: 

Cost-benefit 

Cost effectiveness 

Systems, program and policy analysis 

Cost studies 

Multiple, varied and problem- 
specific 



Resource Constraints: 
Resource F':arcity 
Budget Costs 
Economic Costs 
Social Costs 

Program and Policy Characteristics: 
Goals and Objectives 
Costs 

Alternatives 
Outputs 

Input-Output Relationships * 
Supply, Demand and Price 



IV. MAJOR CX3NCEPTS 
(Continued) 



V. DOMINANT FOCAL POINTS 



VI. INIENDED (JS£S 



to 



VII. ORGANIZATIONAL LOCATION 
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NELDS ASSESSMENT 



PLAM«NG-P»OGI<AMMING-BUIXiETING 



Population Group Characteristics: 
CcHimunity 
Population at Risk 
Target Population 
Service Population 

Planning 

Priority-setting 
Resource Allocation 
Evaluation 
Variable Others 

Indeterminate 
Rarely Discussed 
Often Performed Outside 



Efficiency and Effectiveness 

Marginal Costs and Benefits 
Multi-year Tijne Horizon 
Uncertainty 

Goals and Objectives 
Target Groups 

Program and Policy Alternatives 

Costs 

Problems 

Planning 

Pr lor ity-sett ing 

Resource Allocation 

Program Design 

Evaluation 

Staff office serving decision makers 



with identifying "gaps" between estimates of need and the capacity of 
existing services to meet those needs. Assessing need is necessarily 
forced into processes and activities of valuing and judging the comparative 
claims of different sets of needs. By contrast, the analytical studies 
of PPB were to accept the goals and objectives of agencies (though critically 
examine them) and to assist in acccMnplishing thera through programs with 
least cost or maximum output. While there is no question that PFB 
analysis cannot be free of value judgments, neeas assessment thrusts 
the assessor and user into the very heart of value judgments without 
the benefit of the disciplining effects of costs, resource constraints, 
program objectives or the limits of available know-how and technology. 
3i?§-]3§§#_J§?esOTien^literature^m^ dismisses the key and commanding 

tact th at -need" satisfaction is' not free'. " ~ " 

Major Tool s: The major tools of PPB are basically of three types. 
First, a budget cast in a program classification framework. Second, 
the development and use of a multi-year program and financial plan 
developed under funding constraints or ceilings. Third, a set of 
analytical techniques and approaches for analyzing data which include 
cost-benefit, cost-effectiveness and systems studies. Finally, it is 
significant that emphasis on data collection methods and procedures 
are not a part of the PPB analytic toolkit. 

By contrast, data collection procedures are the dominant types of method 
associated with needs assessment. Though some few have a minimum amount 
of methodological rigor (e.g., survey research), on the whole the techniques 
are not analytic. They are not designed to assist in directly structuring 
problems, tracing their causes or assessing their effects. They are primarily 
devoted to collecting opinions, expert judgment and data for subsequent 
use in whatever analysis or evaluative interpretation might be applied. 

Dominant Foc al Points ; Needs assessment is characterized in a very major 
way by a look awa^ from existing programs and away from an agency's goal 
arid objectives outward toward the community, especially toward the conditions 
and "needs" of the service ana risk populations. In this sense it is very 
"market oriented", very "target group" oriented. This dominant preoccupation 
of needs assessment keeps the literature and the practice of needs assessment 
distracted from the operations and requirements of real public choice processes 
and from the economic political and bureaucratic constraints under which all 
program planning, budgeting and policy-making occur. These blind spots of 
need assessment contribute to insulating the activity from realities" of 
collective choice and from the large body of existing writing on systematic 
techniques of analysis. The problem is only partially knowing our "neeas'-. 
It is also understafiding problem s which create needs and formulating 
effective ways to solve or reduce them. 

Finally, the preferred orga nizational location of PPB analysis and 
planning has always been in a staff location serving decision makers 
directly. Ihe needs assessment literature and practice is quiet or 
indeterminate on where the function of need assessment should be located. 
In fact, a large share of past needs assessments have been conducted by 
groups "outside" the formal framework of a public agency. 
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V. USE MADE OF THE RESULTS OF NEEDS ASSESSMEN'l 

If needs assessment pays off as an aid to policy making (a prime claim 
of proponents) the payoff should be shown through the use made of assessment 
results, iet despite the fact that thousands of -needs assessments" have been 
conducted, documentation of their use is scant. Here is the fragmentary and 
spotty evidence. 

A. I^§^^iewJ^y_ the^Cent and Development ( 1974 ) : 

Under contract to HEVv, the Center attempted to review the "state of the arf 

of needs assessment. They conducted site visits to six projects identi- 

"fied by federal personnel as "exemplary," examined the need assessment 

components of project reports, and sent questionnaires to 102 sites "which 

were thought to have engaged in needs assessment." Beyond finding the field 

full of "confusion" the Center acknowledged these limitations of their review: 

Thirty questionnaires were returned. After reviewing 
tnese questionnaires, CSRD/ORI feels that the results 
are biased, since sites which impleniented needs assess- 
ment successfully seemea to be more likely to return 
questionnaires than sites which were unsuccessful in 
implementation. 

That is, findings of the Center overstate the impact of needs assessment. 

In addition, two of the six "exemplary" projects are unusual. One was 

an information project which was not yet operational by the time of the Center 

study. Its use could not be reviewed. The second was a study of low- income 

households in Detroit in 19b4-65. Ten years old, the Center claims 'it was 

selected for review because of the general impression that significant actions 

had resulted. These "significant actions" are summarized in two sentences: 

...the data were used to get grants, to establish 
priorities and identify what services should get more 
or less money, to quantify need in the low- income 
Communities, and to identity individual iitpediments 
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to an dd«fudtff qudlity of lif*». Ohe qtr-neral consensus 
dinona thosf- individuals contactf^ in Detroit was that 
the data not only provided the basis for justifying 
decisions alreaay made but also led to other decisions. 

Finally, of the 30 questionnaire responses, 13 were from projects of social 

indicators for the dcied, six from model cities/community renewal orograms, 

9 from "service system studies-' and two were unidentified. Within these 

limitations, here are prominent results of the review. 

1. The major "goals" (purposes) of the need assessments were highly 

diversified and characterized in theSf- twelve categories. 

^[sjjT^^ s'Aiseiini&n 

Program planning data 9 

Establish baseline data 9 

Identify individual/community problems 8 

Establish funding priorities 5 

Data for iirproving service delivery system 4 

Develop coninunity awareness 3 

Define operating agency goals 3 

Identify available resources 2 

Model testing 1 

Integration of existing data sources 1 

Inqpact evaluation X 

Staff training 1 



Source: Center, p. 46 
Many of these goals (or purposes) obviously stray from purported attempts to 
influence resource allocation decisions by improvinq understanding of service 
needs. 



2. With respect to the specific prog ram p lanning intent of needs assess- 
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ment, the Center reports: 3(j 



Data obtained through site visits and questionnaires 
returned indicate that a major dissatisfaction with 
needs assessment data stems froti the lack of speci- 
ficity of the data and their incongruence with program 
planning requirements... most respondents felt that 
needs assessment was most useful when it paralleled the 
information needs of program planning requirements (p. 47). 

3. About the use of needs assessment as a way to provide baseline data 
for evaluation purposes , the report found: 

...few, if any, of the needs assessment projects 
were capable of providing adequate baseline data for 
evaluation purposes These data can serve some use- 
ful purvoses, but they cannot contribute very much 
to evaluation research (p. 48). 

4. On using needs assessn«int to identify problems ; 

They (respondents) did not expect that new problems 
would be discovered, although they felt that the 
magnitude of need might become more apparent. As 
one respondent stated: Many people were expecting 
an analysis that would dramatically illustrate the 
needs of the population. In fact, the results were 
predictable and unspectacular (p. 48). 

5. In a summary statement on these purposes, the report concludes: 

From the viewpoint of the practitioners contacted in 
this exploratory study, most needs assessment does not 
provide information which is sufficiently specific for 
program planning purposes. It is usually not designed 
to provide meaningful evaluation data, and it does not 
uncover previously unknown community or individual 
problems. Nonetheless, as one respondent stated, it 
does serve an inportant function by lending credibility 
to and legitimizing the assumptions of planners. 

'We, as planner Sr have a pretty good idea what 
the major needs are in (our area) but without 
documentation it is difficult to prove to the 
state and Federal government agencies that these 
needs exist' (p. 49). 

It is relevant to note at this point that if the primary inpact of needs 
assessment is to lend credibility to or legitimize what is already known, 
it falls within the category of a tool of bureaucratic "proof" and/or 
advocacy, i.e., a political tool. 
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6. H*-fl»-ctinq on thf- findinq that 16 of th<^ 30 Droj*-cts UF5*-d a surv^-y 
dS d primary source* of data, thf- r^-port tHmarks that "ilif- choic*^ of th^s*- 
iTiethodolooi«-s probably rf*fl*'Cts th^ r*-'lativf-lY coirmon hf-\i(-l that rn^nfis 
dssf^ssmfnt is synonymous with survf-y rf'Sf-drch" (p. 50). 

7 Nf'drly all thf- projK:ts us^d s»^VHral typf-s of data but thf- combina- 
tion of the various data sources into a meaningful planning franK^work has 
bf^n miniiTidl ' (p. 50). Ihf report adds: 

However, these data constitute only the ingredients 
not thf- essencf' or final oroduct of inforiration 
necessary for planning and resource allocation de- 
cisions. It J^. in^ the interpretation of the data 
that n eeds a sSMSsii^ e nt" acquire s' its" value", 'and " this 
interpretation requires the coiriFinecj efibrts of the 
technicians, substantive program specialists, the 
potential users of the data, and various others with 
interpretive expertise (p. 54, underlining added). 

3. Nine of the 30 need projects reoorted that their major objective 
had not been attained. Four reported poor study or sainple design as a 
problem, two insufficient resources, ont^ that thf- study was too late, one 
that it was still in process and one that the research objectives were too 
ambitious. The Center found that "the overall purpose's of the needs assess- 
ment" were "perceived" to have be^n attained by two-thirds of the respondents, 
but nineteen did not bflievf- that full use had been made of their findings. 
(Recall that the report cautions that the oattern of responses is biased in 
the direction of successful orojects.) 

An additional set of examples comes from thf- mental health field. 

^' L^^-J^?OP?l^^/?!!!i^„:?^ft'?f'!^ During 1973-77 the iJational Insti- 
tute of Mental Health sponsored five contract projects to stimulate the develop- 
ment of manpower planning capacity at the state level. Each of the projects 
contained a needs assessment component. The impact of these assessments was 

evaluated by tne author as part of a larger study of the overall projects 
ERIC 3 i 



-27- 

(Kiitimel 1977). The proj»K:ts suqqf-st thf widf- ranqf- of activity which is 
included under the label "nneds dssessinenf and thf- vdriability in thfir 
use and impact. The exact locales arf- not disclosed. 

State It The bulk of this $100,000 project was df-votw^. alirost exclu- 
sively to the conduct of a formalized assessment of the "pprceivf<|- estimated 
needs {not demand) for health manpower over the thr^f^ y-ars 1974-77. The 
project was conceived as a pilot for possible export to otn^r states. It had 
a high level of initial interest from both state and federal officials. The 
assessment was carried out by a non-profit university affiliated r^^search 
oraanization and consisted of: 

o Mail questionnaires to 247 human services facilities of which 149 
were usable for the survey. 

o 3f300 Questionnaires to individuals believed to be mental health 
workers. 1,650 were included in t±ie study. 

0 1,229 questionnaires to physicians of which 949 were includf<i in 
the assessment. 

0 1,500 questionnaires to reliqious oraanizations. 900 clerqy res- 
ponded and 779 were included in the study. 

Respondents were asked a variety of questions desianed to elicit in- 
formation about future expansion of mental health services and therr estimates 
of manpower staffing requirements. Ttie questionnaires were well developed but 
the estimates were open-ended and unconstrained by any resource or fundinq 
assumptions. The assessment was directed to service providers rather than to 
service recipients. The final report of the assessment includes 125 panes of 
tabular material based on questionnaire returns and 10 paoes of descriptive 

narrative summary. 

The use and impact of this assessn^nt was mixed and very indirect. 
Itiough it was prepared for use by the state mental health agency, it received 
Q no official deliberation or action there. The reasons are several: 



o The original purposes and uses of the project were never clear; 
the project seemed dominated by a concern with methods and logis- 
tics rather than purpose and use. 

o There was turnover in key state leadership, including the Governor 
and the Caranissioner of Mental Health and Corrections. The prior- 
ity position of mental health programs (and others as well) fell 
under new policies of cost cutting and conservatism. 

o Potential active users of the manpower need assessment results 
began to leave state employment, including both state project di- 
rectors and ::he Director of Community Services. 

o The Conroissioner of Mental Health (now retired) considered the proj- 
ect a "waste." He reported that the project revealed very little 
not already known or which could not be found out more cheaply. 
In his view, the funds spent on needs assessment should have been 
spent directly on manpower training instead. 

o Need data were the object of sharp criticism as "soft", "blue sky" 
(unconstrained by probable budgetary and funding levels), and mere 
wish lists." Three years later the technical director claimed 
that he would not survey "need" again but rather would focus on 
projections of "supply." 

o The data were not analyzed in depth. One federal official recom- 
mended that the state hire someone to review and analyze the 
results. One of the two state project monitors spent time try- 
ing to "tease" some meaning out of the data. He concluded 
(a) "Need" is vague and used promiscuously, (b) To try to relate 
supply to need is naive because there does not exist a model of 
the relationship between "need" and appropriate services, (c) "A 
litany of needs is useless for policy purposes." 

Despite its disputed value as a reliable portrait of future manpower 
demand, results of the assessment were used to support a successful grant 
application to the Federal government. 

State 2; Tliis $64,000 project was devoted to needs assessment in one 
substate health services area. Design of the project was marked by debate 
over which methods of assessment were most appropriate and likely to be use- 
ful. A chief state health officer and a national expert in needs assessment 
pressed for the use of formal survey methods and social indicators. This 
was consistent with the direction of another project already underway in the 
state. By contrast, professional advisors to the project urged that the 
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assessment be nore informal, open-ended and addressed to "problems" faced 
by clients and members of the service area. Interviewees reported that "a 
lot of politics" occurred over the choice of methods. In the end, the cross- 
pressure was resolved in favor of a less formalized problem identification 
orientation. 

A mixed approach was adopted. It consisted of the analysis of and 
inferences from five different types of data: (a) secondary analysis of 
existing data including census data, Federal, state and local service statis- 
tics, and several prior studies conducted by a university; (b) family inter- 
views conducted by university sociology students; (c) a canvas of human services 
agencies concerning views of their own services and their perceptions of the 
needs of the communities they serve; (d) a series of community panel discus- 
sions which included groups of the aged, outpatients, workers, adults waiting 
in line for food stanps, and both high school and college students; and 
(e) data on hospitalized and outpatients collected from the state's patient 
data system, the Veteran's Administration and private hospitals. 

The assessment did not result in a long compendium of "needs." Rather 
it pointed to fundamental problems in the local service delivery system which 
kept citizens from satisfactory care: extremely long waiting lines, token 
sessions with professionals, excessive reliance on medication, high transpor- 
tation costs from outlying areas, no patient follow-up, etc. These were 
focused problems about which something could be done. The results were used 
in the design of expanded local services, the preparation of a federal con- 
tinuing education grant, the revision of university-based clinical and 
conmunity training programs and the development of a new self-financed para- 
professional training program in the local community college. Focused problem 
statements are better points of departure for action tha n genera l and lengthy 
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statements of undifferentiated need . Coirpared to other needs assessment 



approaches, the problem identification and solution approach ap^)eared to 
have high payoff. 

The project report has these things to say about the concept "need": 

In our initial planning for this project we had diffi- 
culty deciding how we were going to define "need". In 
asking a person what he "needs" in the area of mental health, 
it is often difficult to distinguish "need" from "wants", 
"demands", "expectations", etc. Often need is what some- 
one else infers such as "unconscious needs" which were the 
concern of one psychiatrist in our preliminary discussions. 
Sometimes a professional infers "needs" from previous ex- 
perience and from theoretical frameworks. For exanple a 
demographic profile system for assessing mental health 
needs indicated, among its groups which has a high need 
for services, those living in overcrowded housing con- 
ditions or those without a male family head. Social 
scientists familiar with rural State 2 families criti- 
cized these indicators, found to be valid in some areas 
of the U. S., as not being valid in cultural settings 
where large extended families typically provide emotional 
support . 

We decided, as a working definition of need, to use the 
concept of emotional or personal problems which people 
reported as having themselves or having to deal with in 
others. We would explore the variety of ways they de- 
fined such problems, the variety of ways they sought 
help for such problems, and their experiences with 
getting that help. 

State 3 ; When a formal need assessment survey was proposed to the 
Vtorking Task Force established to carry out this project, it was summarily 
rejected. The reasons were two. First, state and local officials claimed 
that a large number of prior needs assesssments had already been conducted 
and had consumed a lot of time. Second, they saw no evidence that anything 
had come out of these prior assessments* As one well-positioned state offi- 
cial put it, "Needs assessments are going on all over the place. Every time 
someone new comes into the state they want to do a needs assessment. Wte're 
surveyed out. The last thing we need is another need survey." Another 



30 



4i 



\ 



official warned! "We are asking people what they need and creating expecta- 
tions that we will do something and we can't." 

Itie approach taken was a loose form of the "nominal group process" 
applied to discussions of the task force. A listing of manpower and train- 
ing needs were generated by three work groups organized around program areas. 
The priority manpower "need" turned out to be administrative management 
training for state and county level clinicians who had just been thrust into 
management positions as a by-product of a statewide reorganization of services. 

State 4 t The assessment of manpower need in this project, like the one 
in State 2, relied on the secondary analysis of existing data. A formalized 
survey was rejected as too costly and too likely to be of marginal value. 
TWO years after its coirpletion the former director (a state university pro- 
fessor) remarked: "We weren't going to do a formal survey of need. For 
God's sake, what is 'need?' Whose needs? What are we talking about? You 
can't get hard data on needs. This push (needs assessment) is preposterous." 

The tack actually taken by the state was modest and mixed in source. 
The bases of the assessment included: 

o Consensus of "need" based on a survey of mental health leaders; 

o A conparison of state graduate projections with vacancies, re- 
placements and needs; 

o Use of a sinple formula developed by NIMH which relates staff to 
the incidence of illness in a specific population; 

o Staff requirements based on criteria established by an Alabama 
court decision; and 

o Staff requirements projected on the basis of a standard staffing 
pattern for a Community tental Health Center supplemented by pro- 
jections based on average national statistics for outpatient clinics 
in the U. S. 

unlike the formal assessment in State 1, this one drew little criticism 
because it was openly acknowledged to be what it was: partial, rough. 
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suggestive, tentative and "soft." State leadership was aware that "need" 
is vague, variable in meaning and not susceptible to rigorous ineasurement 
whatever tool is enployed. 

State_5: Still in the process of being completed, this need assess- 
ment project is, like the one in State 1, highly structured. Technical 
procedures were designed and carried out by a non-profit research organiza- 
tion in another state. Characterized as a "clinical assessment of client 
needs," it is focused on the existing clients in a state mental hospital 
and in selected community programs. At the time of this paper only the 
state hospital component had been completed. It consisted of the following 
approach: 

o Clients were identified through a stratified sanpling of beds. 

o An instrument based on multiple scales (many related to degrees 
of self-care and independent functioning) was administered to the 
resulting set of clients. 

o Multivariate statistical analysis supplemented by case-by-case 
judgment was used to group or cluster patients with similar kinds 
of characteristics. 

o A small (3-4 member) "clinical assessment team" examined the basic 
characteristics of the groups and prescribed "appropriate" services 
for them. Much of this review consisted of attempts to determine 
which groups of patients could be released from the hospital pro- 
viding they continued to receive a minimum amount of therapeutic 
care in another service environment. 

The assessment faced these kinds of difficulties and constraints. First, 

22% of the clients were judged "non- inter viewable" due to the severity of 

their illness or incapacity. Another 14% refused to respond to the voluntary 

questionnaire. An additional 5% were considered so "unigue" or "outlying" that 

they did not fit into the designated patient groupings. In short, 41% of the 

clients were beyond the reach of the assessment framework. Second, due to 

limitations in methodology (primarily the lack of reliable measures and scales) 
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diildren under 14 were excluded. Third, the state project director questioned 
the validity of the service recommendations made by the small clinical team. 
Wbuld another (larger and more sophisticated team) make the same recommenda- 
tions? Fourth, the research group had specialized in geriatric studies and 
had never assessed a psychiatric population before. Disputes occurred between 
the off-site research team and the state project director over the appropriate- 
ness of scales developed for one specialized patient population and transferred 
wholesale to a substantially different population. These disputes were part 
of a generalized tension between the project director and the research staff 
Who had been selected before the project director arrived. Accustomed to a high 
degree of freedom, the research group viewed the project as "nn opportunity 
for tool development." The project director viewed it in to-ns of its poten- 
tial payoff to policy and program concerns of the state agency. These diver- 
gencies in incentives and expectations persisted. Finally, field interviews 
disclosed that the research team had been selected by the agency head for 
political reasons. He wanted "credibility and legitimacy" in the form of 
research findings to justify a set of actions he had already decided to te':e. 
Prior policy decisions led to the assessment and to the selection of the 
assessors and not vice-versa. 

Lessons of the Five Projects ; Major conclusions which can be drawn from 
the set of five projects apprear to be these: 

o The label "needs assessment" may be applied to any approach, pro- 
cedure or method, ranging from "thinking sessions" to technically 
complicated surveys. 

o Needs assessments which are conducted without assumptions about 
future resource, budgetary or funding constraints are likely to 
be judged "blue sky" and unrealistic. 

o Needs assessment results which fit the political predispositions 
of policy makers are more likely to be used than those which do 
not. 
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o Assessments which use multiple and existing sources of data and 
inforitiation are likely to be low in cost and still yield informa- 
tion precise enough for most agency purposes. 

o Assessments conducted by outside groups (e.g., research groups or 
universities) are more likely to be oriented toward technically 
elegant issues of interest to intellectuals than to practical 
issues of more interest to program and policy officials. 

o There are political and ideological issues at stake in the selec- 
tion of needs assessment approaches. 

C. HEW Region X's National Management Planning Study of 1976 : Another 
ey-^irple of findings on the apparent impact of needs assessment comes from a 
broad-based appraisal of the utility of the "overlay of planning programs" 
imposed on state and local governments by Federal agencies and Congress. 
HEW Region X staff examined planning requirements (including needs assess- 
ment) and practices associated with all 46 HEW formula grant programs for 
state and local governments and for eight of the largest project grant programs. 
They also interviewed a broad set of Federal, state and local officials. 
The study concludes with these telling general findings: 

TSiis study finds that HEW requirements for management 
planning are inconsistent and appear to yield little 
evidence of such planning in state 'plans' and appli- 
cations. It finds that the state 'plans' are primarily 
conpliance documents. Most significantly, it finds that 
the conpliance requirements found in the statutes and 
regulations administered by HEW not only fail to gener- 
ate management planning but in fact work against State and 
local managemet planning (HEW Region X, p. 81). 

In its closing paragraphs the study reflects on commonplace federal planning 

requirements in a hood of fundamental doubt and questioning by quoting a 

local official: 

How is needs assessment done in an adequate, meaning- 
ful ajr«3 economic fashion? More basically, how does one 
define need- who defines it, how is it documented? 
What conprises resource assessment and how is it carried 
out in a sufficient and economical manner? What neces- 
sary relation does identification of needs bear to a 
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resource assessment? What real utility is there in 
an overlay of needs and resources for identifying 
"gaps" or "unmet needs"? VJhat level of significance 
or role does an identification of need or inventory 
of resources play in setting of priorities and ob- 
jectives? What are the other appropriate subjective 
political factors that share a place in developing 
priorities and how are these integrated with more ob- 
jective or quantitative analyses? 

D. Evidence of a National Conference ; A final body of fragmented 
evidence on needs assessment comes from a four day conference on needs 
assessment in "health and human resources" held in IxDuisville, Kentucky in 
June 1976. Eighteen papers were presented to about 250 conference partici- 
pants. The proceedings (Bell, 1976) tell much about the current state of 
needs assessment. First, roost of the papers are critical of the alternative 
approaches to needs assessment. They point to limitations of, for exanple, 
epidemiology (Dunham), health status indicators (Turns) and social indicators 
(Bloom). The conclusion of nearly all the speakers was that single approaches 
to needs assessment are inadequate. They urge multiple approaches, presumably 
on the grounds that weaknesses of one approach will be offset by strengths 
of another. Second, despite the fact that the conference was dedicated to 
discussing the usefulness of needs assessment, the eighteen conference papers 
include only five examples of what were purportedly actual assessments. 
Four of the exaitples were provided by one speaker (Demone). Of the five 
exanples, one was a description of the development over several years of a 
large sample survey which was not yet finished (Sundel). Another was a 
political case study, not of needs assessment, but of the failure of atteitpts 
to sell fluoridation to communities despite the scientific evidence which 
indicates that fluoride reduces dental cavities. A third example is a brief 
and vaguely desciibed case of data collection on home health services for 
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the Visiting Nurses Association merely accompanied by the assertion that 

needs data was used in decisions aoout the allocation of nurses' time. The 

fourth example - estimating the number of mentally retarded - is one in 

Which an actual count of retardates generated a number which was roughly 

20% of the number which had been proclaimed by program advocates. The 

actual census indicated a retardate population of approximately 35,0uu 

rather than an estimate of 165, OUU based on the rule of thumb that 3% 

of the population had an IQ below 70 and therefore were retarded. Of the 

35,000 only 25,000 were judged severely retarded. A follow-up was conducted 

to establish what had happened to retardates who had remained in regular 

schools. Of those who been * labeled" retarded and put in "special classes" 

curing their school years, b5% 

had been working steadily since they left special 
classes and they left between ages 16 and 21. Their 
general occupational and social adjustment was about 
the same as siblings and peers of comparable age. 
iheir major problem, we concluded, was the school 
labeling process which they and their families (fortu- 
nately) tended to reject following school termination 
(p. 251-2). 

Here is the author's reflection on needs assessment in this case: 

My conclusion, I think is increasingly shared by 
most sophisticated observers in retardation, and 
that is that prevalence studies are unnecessary and 
wasteful (p. 251). 

The final example relates to alcoholism in the 1950 's. A set of 

state estimates were developed on the basis of a then-popular formula 

(Jellinek) and on the number of formal contacts by alcoholics with 

various agencies. The estimates were not generated from intellectual 

curiosity but out of "political necessities*-, 'how could we compete 

effectively with those touting the incidence of tuberculosis, criine, 
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mental illness r heart disease or cancer without our own score card?' What 



use was made of the estimates? 

As for utilization of the data by my bosses in the 
executive and legislative bodies, the gap, by either 
needs identification method was so great we frightened 
rather than encouraged them. At one of the Governor's 
budget writing sessions . . . one of those present 
concluded, reasonably I thought, that 'Demone was crazy.' 

After the critics began to maRe their own calulations based on their 
acquaintance with known alcoholics, 

llie net result was that I regained some lost credi- 
bility, although the first remark was still a telling 
one, and the small increase in our annual operating 
budget was recomnended to the legislature (which the 
legislature turned down by the way) (p. 249). 

Danone also notes: 

Now sixteen to twenty years later, neither state 
(Massachusetts and California) even now, has the 
resources to offer therapeutic services to those 
who could be identified by actual count in the 1950 's. 

So our problem is not aK>arently a bias to an over- 
estimation of the extent of the potential population at 
need. We have more alcoholics than we can use. It_is a 
ve ry un por tant poli cy que stion, you see, beca use by t he 
time you suddenly believe your data> (a nd no one really 
beileved' it f or a long time) then you have to t hink of 
your po liclei a nd your pr ogram (pp. 248-250, underlining 
added). 

Bie conference proceedings provide a large number of claims for the value 
and use of needs assessment but no additional evidence. 



E. Sumroary: The available evidence suggests that activities carried 
out under the label "needs assessment" are diverse, rarely judged directly 
useful for policy-making purposes, and inspired or rationalized by reasons 
which are often only vaguely related, if at all, to resource allocation 
decision-making in public agencies. 
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VI. LIMITATIONS OF ONE APPROACH TO NEEDS ASSESSMENT: FIELD SUPVEYS 



One method of generating data for needs assessment, the field survey, 
deserves special mention because surveys are frequently mentioned in 
the literature and are often promoted vigorously in practice. State-wide 
surveys conducted by Florida and Oregon are referenced because they were 
large, relatively expensive, laid claims to basic validity and utility, 
were judged by some worthy of export to other states, and illustrate 
well the pitfalls of attenpting to use surveys to iirprove allocation 
decisions among conpeting claims in a public agency context. 

To some (usually survey researchers) a field survey is the preferable 
(superior) method for needs assessment. Yet surveys have been in use for a 
long time and they are not magical. The typical limitations and problems 
of a survey are several. 

1. The cost of a survey can be high, especially when a detailed 
questionnaire is administered to a relatively large sanple dispersed over 
a large geographical area. A survey of any significance will probably be 
more expensive than any of the alternative approaches to need assessment. 

2. While sairples can be drawn with statistical rigor, sanple attrition 
and non-response rates may affect substantially the representativeness of 

an actual set of respondents. 

3. A survey typically relies on self-report data. Self -reporting 

about conplicated individual and social problems is frequently unreliable. 

Individuals may have mental health problems, for exanple, (or hypoglycemia 

or dietary deficiencies) and not be aware of them. Similarly, they cannot 

be expected to know of subtle physical, psychic or social problems unless 

the problems have been reliably diagnosed by conpetent specialists. Even 

experts disagree over the diagnosis and treatment of a wide variety of 

human problems. In addition, some subject areas are extremely sensitive 
O 38 4,9 
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and do not lend themselves readily to reliable exploration through a survey 
interview? for exanple, marital problems, child abuse, alcoholism and 
abuse, drug use and abuse, abortions, etc. In short, surveys are not likely 
to be effective instruments for gathering reliable perceptions of sore 
inportant and basic human problem (need) areas. 

4. Survey researchers tend to prefer pre-structured and close-ended 
questionnaire formats because data is then easier to tabulate (although 
not necessarily easier to interpret). Pre-structured alternative answers 
to questions also speed an interview which must stay within the con- 
straints of time, cost and the patience and time of the interviewee. But 
semi-structured and open-ended questions are often more effective vehicles 
for exploring life habits, styles and circumstances which create or inten- 
sify many human needs and problems. The exploration of "causes" of problems 
(and thus effective remedies) rather than symptoms requires more time and 
the skill of an experienced and sensitive interviewer. Anyone who has 
filled out, designed or read the results of survey questions has probably 
wondered about what difference it would make if a given question had been 
asked in a different way or had been preceded or followed by related or more 
probing questions. 

5, If it is used to estimate the incidence of needs in a population, 
the validity of a survey depends in part on the extent to which the sanple 
of respondents is "representative" of the larger population. Actual field 
surveys must rely on voluntary cooperation, and cope with a mobile and 
changing population, many of whose problems are "one-time" or transient. 
"Representativeness" may be hard to achieve. Several observers have warned 
against the seemingly commonplace "ecological fallacy" associated with 
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surveys and social indicators; i.e., attributing to individuals within a 
community the characteristics of a community as a whole. 
AM E XAMP LE; There are a number of additional pitfalls which may result from 
survey sampling metnods, questionnaire item construction, interviewing 
methods, techniques of data manipulation, etc. Some of them are illustrated 
by a large state-wide survey conducted by the irloriaa Department of Health and 
Rehabilitation Services, a newly formed umbrella human resources agency 
(3 volumes, 197b). In an effort to satisfy the Federal requirements for 
a social services planning process under Title XX of the Social Security 
Act, the Department spent hundreds of thousands of dollars to conduct 
a "comprehensive" needs assessment. It consisted of three surveys of 
l,lb7 community residents, 1,76!* existing service clients of the Department's 
services programs and 1,154 "key informants" (Department officials, teachers, 
employment service workers, counselors, social workers, etc.) This case is 
worth examining because reports of the results of the assessment claim 
that the surveys provide "a scientifically derived data base" which can 
be used to assist in planning and resource allocation decisions. The report 
claims that "estimated proportions of unmet need can "degoliticize the 
allocation of scarce resources." Finally, this method of needs assessment 
was being promoted by some hkM officials for export to other states. 

Despite these ambitious claims, a brief examination of the surveys 
reveal a set of limitations and ambiguities which significantly constrain 
the usefulness of the "scientific" data base. First, the client survey 
was heavily "categorical" rather than general. Not one, but at least 
eight samples were drawn, one for each of the eight major existing program 
areas of the Department (e.g., vocational rehabilitation, children's 
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medical services, retardation services, etc.). This strategy established 
a minimum sample representation for each program regardless of the relative 
size of the actual service client populations. Since a significant share 
of existing clients receive services from more than one program, this 
sampling strategy also produced double-counting and thereby exaggerated 
tne total number of individuals in the client population with needs. 

The categorical emphasis of the client survey was reinforced by a 
prestructured closed-end format. If clients had problems or needs which 
fell outside pre-selected areas, regardless of their severity, they were 
not asked about them. In general, the categorical emphasis of needs 
assessment is encouraged by federal laws and regulations which require 
assessments program by program and category by category Redundancy, gaps, 
overlap, and double-counting are probably coirenon. 

Second- three sets of clients were excluded from the survey: those 
in the Department's three state institutions, and those receiving services 
in alcohol and drug programs. Obviously tne needs of these three groups 
did not show up in subsequent calculations of priorities. 

Itiird, although an attenpt was made to cover 56 ''problem areas' , ser- 
vice utilization questions were not included for 22 of them because they 
would have made the questionnaire too long or too complex. As it turned 
out, four of the ten most frequent problem areas identified by respondents 
were among the 22 for which no estimates of "unmet need" could be calculated: 
inadequate nutritional intake, need for outreach services, mental health 
problems and needs for information end referral. 

Fourth, some areas were covered by the questionnaire in such a cursory 
way that no sense can be made of reported findings. For example, only 
one "yes-no" question was included on the recreational needs of children. 
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V^hile 27% of the clients and 19% of the community residents reported 
••recreational problems" (presumably for children) survey results provide 
no insight about what kind of recreational opportunities were needed or 
for what types and age-levels of chilaren. Similarly, while a need for 
"information and referral" ranked sixth in terms of the largest "unmet 
needs" of clients, the survey proviaes no clues about subjects or services 
for which clients wanted information or referral. 

Fifth, responses to survey questions were tabulated by frequency. 
Itius, in general, all answers were weighted equally in a "one person-one 
vote" fashion. As a consequence, the higher the response rate by program 
or sub-state district, the greater was the weight provided to responses 
in those areas. The variability in response rate seemed most extreme 
among "key informants". While an overall average of 77% of the individuals 
responded, the response rate for vocational rehaoilitation counselors 
was a high of 96% while that for teachers was a low of 48%. As a natural 
result, views about needs held by VR counselors were proportionately of more 
weight (twice as much) than those of teachers. Variable response also 
characterized key informants in the 11 districts. Four counties with 
42% of the population, for example, accounted for only 8.47% of the total 
responses. As a consequence views of "needs" in those counties were 
considerably under -represented. ^ 

Sixth, the short two-page key informant questionnaire mergea and 
thereby obscured two sets of distinctions which are inportant for resource 
allocation and policy purposes, (a) Individuals were asked to select 
and rank five target groups which needed the "most urprovement in services 
sucti as expansion or quality.- In terms of their budgetary and program 
developnent inpl ications , improving the quality of existing services 
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is drastically different from expanding them. There is no way to tell 
from survey results whether key informants thought that services should 
be improved in quality, expanded, or both for the five priority groups which 
they selected, (b) Similarly, individuals were to rate 39 problems in 
terms of which were "most frequent and/or severe." Again, "frequency" 
and "severity" are two fundamentally different attributes of problems. 
Merging them in one question generated ambiguous results. Common colds 
are more frequent than child abuse (we hope) but most would probably 
agree less "severe." Lumping together problems of high and low frequency 
and greater and lesser severity is of little help. 

The limitations and pitfalls of the Florida state surveys are not unusual 
or unique. Francis (1977) recently reviewed a state-wide needs assessment 
conducted on social services among "key informants" (officials) in Oregon. 
He concluded that the survey and the interpretation of its results were 
fraught with problems and should be given "low marks" as an aid to decision 
making. He concluded that surveys may be good for some purposes, "But polls 
are not a useful device for determining answers to complex, interdependent, 
mixed fact/value issues." His listing of serious short-comings of the Oregon 
study overlaps substantially problems reflected in the Florida surveys. 




VII. PRIORITY RANKING NEEDS 

According to many advocates, needs assessment is designed to guide 
resource allocation decisions, partly through ranking needs in priority 
order. The Florida surveys provide a concrete exanple, though the problems 
we will highlight are endemic to all survey assessments. An attenpt was made 
in each of the three surveys (client, resident and key informant) to have 
individuals select from a list and rank-order the five roost pressing 
unmet neec's or target groups. The table on the next page compares the 
rankings of the three groups. As might be expected the rankings varied 
from group to group, confirming what has been called "Mile's Law: Where 
you stand depends on where you sit." 

The table indicates that the clients and residents identified four 
of the same priorities out of five but they ranked them differently. The 
key informants selected and ranked areas that were, with one exception 
(transportation), different ^'''om the areas selected by the other two groups. 
Similarly, when key informants ranked both "unmet needs" and "pressing 
problem areas" only three of the five areas were common (unenployment, 
child abuse and malnutrition) and these were ranked in different order. 
"Mental health problems" were among the top five areas only in the list 
of the key informants. Finally, regardless of whose priority list you 
inspect, some problem areas appear interdependent in cause and remedy. 
Some portion of common dental problems (identified by clients and resi- 
dents) are surely due to poor diet and malnutrition (identified by key 
informants). The reported needs for foodstanps and financial assistance 
(identified by clients and residents) are caused in part by unemployment 
(identified by key infcmants) . Some child abuse is probably caused 
or triggered by the circumstances of unemployment or welfare status. 
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CX^IPAMSON OF RANK-ORDER OP TOP FIVE 
UNMET NEEDS BY RESIDENTS, CLIENTS AND KEY INFORMAMTS 

STAT£ OF FLORIDA 



Coranunity Resident 
Survey 1/ 
(n « lrl87) 

Routine Dental Care 

Food Stamps 

Financial Assistance 

Information and Referral 



Client Survey 2/ 
(n = 1.769) ' 

Routine Dental Care 

Financial Assistance 

Food Stamps 

Utility Problems, 
including telephone 



Transportation Problems Transportation Problems 



Key Informant Survey 3/ 
(n = 1,154) 



Unmet Need 



Low- income 
Medical Care 



Most Pressing 
Problen Area 



Unemployment 
Child Abuse 
Malnutrition 
Transportation 



Child Abuse 
Abuse of Elderly 
bneirployment 
Malnutrition 



Mental Health 
Prc*l«ns 



1/ Department of Health and Rehabilitative Services, July 1976, pp. 35 36. 
2/ Department of Health and Rehabilitative Services, July 1976, pp. 32-^J. 
3/ Department of Health and Rehabilitative Services, February 1976, p. 3i. 
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Priority lists of^ uij?>g-t^j?f-^d% f^stdbli shed by " voting " tend to obscure 
rather tn<m clarif^r^^ P*^tur?. ^nd conseguence of these potentidl causal 
pr oblHn c hdins, " 

I>jving aside the limitations of the surveys which we identified 
earlier, where (and why) would you put your money if you were a Florida 
decision-maker with, say, $5 (or $5 million) to allocate? Here are some 
alternative investment strategies which might be applied to the Florida 
priorities, or to any other set of ordinal ly ranked alternatives. 

1. Invest the entire $5 dollars in priority number one. If you 
choose the too priority of the clients and residents your money would go 
into routine dental care; but if you choose the number one priority of key 
informants it would ao into either unemployment or child abuse. If the 

$5 were allocated among these three top priorities, how much would you 
distribute to each area and why? Leaving aside priority order, you might 
decide to put the whole $5 into the most common area across the four 
lists - transportation. The problem with putting the entire available 
amount into any one area is that the others go unaided. This seems an 
unsatisfactory investment strategy and one which creates choice problems 
despite its simplicity. 

2. In the name of "equity you might put $1 into each of the top 
five priority areas. Then you would have to choose between the priorities 
ot the clients and residents on the one hand and those of the key informants 
on the other since their lists are starkly different. How and why would 
you choose? 

3. Invest in an area up to the point where estimated marginal benefits 

equal or exceed estimated marginal costs and then shift investment to 

another area and do the same. More comprehensively, you could invest in 
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areas with the highest benefit-cost ratios or the highest cost-effectiveness 
ratios. Unfortunately the Florida studies (or any other needs assessment 
we have seen) do not supply information on the basis of which these 
estimates could be made. 

4, Invest in areas where there is the smallest (rather than the 
greatest) "unmet need" on the assuitption that the know-how to reduce need 
has been demonstrated to be greatest in those areas. 

5. Invest in programs where experience, knowledge and research 
indicates that there will be multiplier effects. According to this 
strategy, for exaitple, an investment in employment programs may generate 
direct personal income and taxes which would permit further investments in 
the alleviation of other problems. Again, the Florida studies did not supply 
information necessary for these calculations. 

6. Invest in areas which have the greatest "political feasibility." 
As a decision-maker you may decide that none of the top five are areas 

where investments are politically feasible. Again, needs assessments (includ- 
ing the Florida Studies) do not provide information about political 
feasibility or desirability. 

7, A large number of other alternative and mixed investment or 
budget allocation strategies are possible. 

The key point should be clear; while "priority lists" are appealing 
on their face, they are of little direct help in actually deciding upon 
reasonable resource allocation strategies. 
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VIII. SELECTED ISSUES AND PERSPECTIVES RELATED TU NEEDS ASSESSMENT 



Efforts to "assess need" in a technical way are not new. They beai?, 
a strong family resemblance to earlier and similarly unsuccessful historical 
attenpts like those of Jeremy Bentham who» in the 19th Century, trieo to 
develop a '•felicif ic calculus" by which one could gather and synthesize 
diverse individual preferences into consistent group choices which would 
sujposedly ensure maximum happiness and human welfare. Since then, there has 
accumulated a large body of technicals esoteric and often unproductive 
speculation and writing on this subject. In a soninal analysis of the general 
problem. Arrow (197u) concluded that aggregating individual preferences into 
collective choices or decisions cannot be done technically in a reasonable 
and satisfactory way. There have since been no canpelling rebuttals to Arrow's 
conclusion. Arrow was dealing with 'preferences". The current concern is 
with "needs which are analytically even more evasive and intractable. Here 
are sane of the reasons. 

A. A Merg ing of Needs and Wants? Some of the obvious confusion associated 
with needs assessments arises from a lack of clarity about the differences 
between needs and wants or, indeed, preferences. Except in extreme cases 
(e.g., abject poverty) the distinction is no longer easy to make. Conmenting 
on this contemporary dilemma, Bell (1976) recalls that when Aristotle spoke of 
man's "natural needs" he meant sufficient food, clothing, shelter from the 
elements, care during sickness, sexual intercourse, cc»npanionship and the 
like. These needs are biologically derived and are limited and satiable . 
The use of the word "need" was then sinple. Bell argues that times have 
changed. The " private household" where these early notions of need applied 
has been displaced by the "£ublic household" where they do not. We now have 
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a political economy which is a mixture of government and a modern bourgeois'" 
market economy. Now the motives for the acquisition of goods are no longer 
exclusively needs but also wants. 'In bourgeois society r psychology 
replaced biology as the basis of 'need' satisfaction. ... In Aristotle'? 
terais. wants replaced needs - and wants by their nature are unlimited and 
insatiable." 

. . . the public household now becomes the arena for the 
expression not only of public needs but also of private 
wants. . . . Above all the basic al locative power is now 

political rather than economic The fact that the 

public household becomes a 'political market' means that 
the pressure to increase services is not necessarily 
matched by the mechaiiism to pay for them, either a rising 
debt or rising taxes, {pg, 222-227) 

This historical movement from a notion ot needs as biologically based and 
limited, to one which is psychologically based and unlimited is part of the 
curr^t cultural backdrop of social or human resources programs. The 
boundary between wants and needs has always been hazy because individuals 
are not always clear about their -real'- needs versus their wants. Except 
in extreme cases their formulations change depending on their circumstances, 
available choices (including resources) and preferences. The overlap, 
merging and confusion of need and want (and sometiities preference) is one 
reason why there are often differences between self -perceived and self-reported 
needs of, say, a client of a social welfare program on the one hand, 
and needs perceived (or diagnosed) and reported by an expert (e.g., 
a clinical psychologist, caseworker, etc.) on the other. 

The intertwining and mingling of needs, wants and preferences can be 
demonstrated in a siirple way: Do a needs assessment on yourself. How sure 
are you that your needs are not your wants are not your preferences? Discuss 
your self assessment with someone else. How sure are you now? The merging 
of needs, wants and preferences is a basic reality. 
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B, Knowledge is li mited : Proponents of needs assessment a ssume that 

if needs were only known, public agencies could do something about them. 

Unfortunately, we know less about how the world works and how to change 

it than we sometimes admit. After years of research there is still limited 

understanding of the determinants of child learning, the origins and cures 

of many diseases, the etiology and effective treatment of many types of 

mental illness, and the remedy for many of the social pathologies associated 

with poverty including crime and delinquency. Failures of many programs 

developed under the banner of the "great society" underscore the fact that 

money is not enough. Millions of dollars worth of evaluation studies 

later, few would claim that governments are in possession of many tried and 

tested remedies for our basic social, psychological and physical ills. 

After several years as the Deputy and then Assistant Secretary for Planning 

and Evaluation in HEW in the late sixties, Rivlin (1971) summarized her 

judgments about "What do we Know?" about the production of effective 

health, education and social service programs. 

Again the answer is discouraging. So far the analysts 
can provide little useful information about the relative 
effectiveness of various educational methods or health 
delivery systems. Moreover, there is scant analytical 
basis for predicting the behavior of individuals and 
families in response to changes in incentives or avail- 
ability of new services (p. 64). 

A review of a recent anthology of 20 articles by experts on why we are 

"Doing better (spending more money) and feeling worse (showing no or little 

improvement)" in health confirms the boundaries of our knowledge in this 

area (Knowles, 1977). It appears that even if we could comprehensively 

identify our health "needs- we could not create services which would do much 

if «ny good to satisfy many (most) of them. There are two basic reasons. 
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First, only about 10 percent of the variation in health status seems 
attributable to medical care (p. 105). Most experts tend to agree with 
Knowles that "The health of human beings is determined by their behavior, 
their food and the nature of their environment." We do more to determine 
our own good or ill health than medical services do for us. It seems that 
"Prevention of disease means forsaking the bad habits which many people 
enjoy - overeating, too much drinking, taking pills, staying up at night, 
engaging in promiscuous sex, driving too fast, and smoking cigarettes 
..." (p. 59). Mass education programs about the cancer causing effects of 
cigarette stroking and the death and disability consequences of excessive 
alcohol seem to have done little for these disease- inducing individual 
practices. We seem intent on making ourselves sick. Second, even though 
we know, for example, what the ten largest causes of death from disease 
are, we know precious little about what to do about them (pp. 38-41). 
Based on a review of "the science and technology of medicine", Lewis 
Thomas, President of the Memorial Sloan Kettering Cancer Center in New 
York City, concludes that "We are left with approximately the same roster 
of common major diseases which confronted the country in 1950, and although 
we have accumulated a formidable body of information about some of them in 
the intervening time, the accumulation is not yet sufficient to permit 
either the prevention or the outright cure of any of them" (p. 37). 

Though "causal" knowledge and the art of effective program intervention 
varies from area to area and problem to problem, we ar e safe in assuming that, 
collectively, we know less than we think . 

C. Philosophical Premises ; There appear to be several inplicit 
philosophical premises on which the needs assessment literature rests. 
First, the search for needs is an implied argument for "more" services 
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rather than less. Ihe premise appears to be expansionist. It seems 
unlikely, tor example, that a needs assessment woula be conducted unless 
there were some prospect of uncover ing more needs. It also seems unlikely 
that program officials would sponsor a needs assessment if there were a 
real prospect that the assessment would disclose either that a set of 
specified needs were already satisfied or that existing service capacity 
alreedy exceeded the demand from all those ''ir. need," 

Second, and linked to the first premise, there seems to be un implicit 
assumption in the needs literature that ^vernment should provide whatever 
aoditional services are required, (See, for example Levitan, Lewis, and U,S. 
DHEW July 1976), This pro-government bias of needs assessment is interesting 
in light of rising public sentiment over the past d-lu years that government 
is too big, too intfficient and too expensive. It is also a premise which 
is suDject to basic disagreement on the grounds of both political philosophy 
and service effectiveness. It is not obvious that even if there were collec- 
tive social agreement that a new service should oe provided or an old one 
expanded that provision of that service should be made by government bureaucracy, 
A grand alternative to government provision of more services to the ^^or 
which has been proposed with some force over the last few years, for exanple, 
is a so-called incomes policy. Under this approach the poor would receive 
a minimum guaranteed income to be spent at their own discretion. Government 
would not be called upon to expand furtiier the narrow, categorical support 
for services which grew up in the late fifties and early sixties and resulted 
In the overlapping, redundant ana fragmentary service system we now have. 
In roost areas there are plausible if not priferable alternatives to direct 
government intervention and subsidy. The needs assessment literature 
autoinically assumes that the preferred provider is the government. 
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A third assunption seems to be hidden only in that portion of the needs 
assessment literature which proposes a survey as the preferred method. That 
assumption is that new data is better than existing or old data. The assumption 
is a push toward new data collection as the only reasonable course of needs 
assessment . 

D. What_Is To Be Done With Needs Data? A large share of the literature 
on needs assessment is silent on this question. The simple assumption is 
apparently made that if needs data are gathered they will be used automatically. 
V^hen the use of needs data is considered consciously, several alternative 
vehicles for use are proposed. First, a number of advocates recognize that 
needs assessment is only one input to decision processes. To get that input 
into use they propose a "process", where that process is to be located, who 
is to be in it and what it is supposed to do is unclear. Presumably, "the 
process" can be none other than "the decision-making process" itself. A 
second group of advocates feel uncertain about how tiie data from widely vary- 
ing and multiple methods can be somehow synthesized and made sense of as a 
precondition for use. Bell (197b), for example, proposes that a -Comprehensive 
Assessment Model" be tried. That model is simple in concept. It has three 
components: (1) a service utilization conponent that is based on utilization 
data; (2) a social indicator component which is focused on a particular 
geographic unit; and (3) a citizen survey component. Like so many other 
recipes for needs assessment, however. Bell does not tell us what to do with 
the data from the three components. His paper concludes with these unhelpful 
statements" "...our goal is to triage this aata base tor planning." 
"It (the model) was predicated upon the belief that multiple assessments are 
ijiportant to a comprehensive view of the comm'Jinity" (p. 243). Ihe reaoer is 
left again with advice which is of no help: Every needs assessment method is 



weak. lo overcome the weakness o' individual methods, use multiple 
methods. To make sense out of the data from niultiple methods, make them 
"convergent" - "triage" them. 

^* ^g-Contex t I s Pol i t ical t Needs assessment does not occur in a 
vacuum, if the results of an assessment are to be useful and used they 
roust fit the context in which all public agencies operate. That context 
is inherently political. In terms of one of its major functions, the 
political system is itself the vehicle for needs assessment. Neeus are 
articulated, appraised, weighed and converted into action by the normal 
behavior of the political process. It is somewhat ironic that a set of 
data collection methods should be proposed as a refinement of one of the 
central functions of the American political system. The existing system 
is worth a brief review. 

In broad stroKes, the American political system is characterized by a 
high degree of social pluralism, the existence of a significant degree of 
value diversity and by interdependence among social means and ends. The 
system is fragmented and decentralized; influence is widely distributed 
over existing value positions, while there is consensus on the "rules of 
the political game," there is substantial conflict at the margin over values 
related to specific policies. In the decision processes, value conflict is 
resolved among "partisans" who mutually adjust their ends, means, and stra- 
tegies through a variety of techniques such as partisan discussion, bargain- 
ing, negotiation, reciprocity, authoritative prescription, etc. 

As outcomes of this process, policy is typically compromisea; policy 
outccjmes are "shared." Policy is made incrementally rather than conprehen- 
sivelyj that is, changes are typically made at the margin of existing 
policy. (Kimrael, 196fa) 

54 60 



In this system, public agencies are not mere machines that follow 
rationalistic recipes of choice. Decisions do not occur in a one-time 
fashion but in intricate streams over long periods of time. Programs do 
not appear by virtue of "big decisions" but rather evolve through decen- 
tralized and fragmented processes of conpetition and adjustment among 
partisan interests. Programs, like budgets, grow incrementally and slowly, 
not in great leaps or quantum jumps. 

Contrary to the assumptions of needs assessors there are no tidy and 
orderly sequences in which decision makers first assess need, then inventory 
resources, then identify gaps and then choose. Decision makers operate in- 
stead within vigorous constraints and small margins of freedom. Most human 
resources agency heads, for example, probably have "control" (and then only 
indirect) over no more than about 5% of their agency's budget. The rest is 
already committed to ongoing programs with built-in growth factors and pur- 
poses specified in statutes. Most decision making takes the form of trying 
to find actions which are politically feasible through marginal changes in 
the existing pattern of resources. This process of adjustjT\ent at the margin 
does not occur out of laziness or malevolence but out of the fact that the 
existing base of resource commitments represents the resolutions and com- 
promises of past decisions. 

In this politico-bureaucratic context, knowledge does not get converted 
into policy in a linear and clear way. Years of program evaluation and policy 
analysis bear witness to this fact. Experience suggests that the principal way 
that analysts have an iitpact on policy is by becoming, directly or indirectly, 
partisan participants and advocates in the policy process itself. If the results 
of assessments are to inpact on policy they must be used and advocated by partici- 
pants in the process. To make themselves felt, assessors, like analysts, will 
probably have to become skillful political partisans. Equally inportant, they 

er|c 6e 



will have to learn to tailor analysis to specific problems "at the margin". 
**Coirprehensiveness" in a fragmented politico] system is a dubious virtue. 

F. The "Gap" Model ; Some of the literature suggests that needs 
assessment ought to be a step in a resource allocation model, indeed the 
first step. The proposed "gap" model goes like this: 

First, assess needs 

Second, inventory resources 

Third, compare needs and existing resources anc' identify gaps 

Fourth, establish priorities among the "gaps" (unmet needs) 

Fifth, allocate resources 
While it has the appeal of siitplicity, this model is never followed in actual 
decision making. It may suit the logical ordering of a "rational" mind, but 
it is unsuited for collective choice. There are several reasons. First, 
there is no way to simultaneously assess all our needs. The model throws 
one into a paradox. If we cannot assess all our needs, which needs shall 
we assess first? If we are in a position to know which needs are more de- 
serving of being assessed first, then we have already made up our minds about 
which needs are the most compelling. If that is the case, then why assess 
needs? Similarly, if we assess only part of our needs then how will we know 
whether the ones we assess are more important or worthy of meeting than the 
dies we have not yet assessed? 

In actual practice, human resources agencies are thrown into the position 
of assessing only partial needs - those that are covered by categorical pro- 
grams. Taken literally, federal laws and regulations which require needs 
assessments do so largely for individual programs: mental health centers, 
libraries, nutrition, vocational education, social services for the aged, 
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etc. What should a state comprehensive human resources agency do when con- 

tronted with requirements for multiple needs assessments through multiple 

federal categorical programs? Do one for each program? How will needs then 

be cc»npared across programs? And what of double-counting which is sure to 

occur? We know, for example, that recipients of federally funded service 

piograms often have multiple problems. If their neeos are counted indivia- 

ually along categorical lines the total of those estimated in need will far 

exceed those actually in need. And what criteria shall be employed to decide 

which needs should be met with a limited budget? Should education needs be 

first, or health needs, or housing needs, etc.? Neither the model nor the 

literature which espouses it provides any guidance on how to choose. St. anded 

on its first step, the 'gap* model is interesting but of little use. 

Even used for a single program, the "gap" model is seriously deficient. 

In a recent critique of estimates of need for vocational rehabilitation, 

Levitan (1977) found tnat: 

Where prevailing universe of need estimates have indicatea large 
service deficits, different assumptions yield much lower need totals 
aiid raise a new set of policy considerations.... As the level of 
service increases relative to need it is more and more crucial to 
consider whether the next increment in servicp' is having the desired 
effects or an acceptable rate of return (pp. 74-75). 

The consid*;ration of marginal effectiveness is appropriate in the case of 

ever^ program, and is not addressed by needs assessment methodologies. 
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IX. A RECAPITULATION 

This paper has drawn on a sampling of the liter at re to expose the 
anatomy, espoused purposes, claims, criticisms, and uses of needs assessment. 
Major conclusions can be suninarized briefly. 

First, the Federal government has prescribed that needs assessment 
be conducted as a precondition for grant support or as part of a plan or 
planning process. Federal laws and regulations, however, are always 
silent on what "need" means and usually silent on what methods or procedures 
should be employed to conduct a needs assessment. Tellingly, HEW does not 
make decisions based on national needs assessments. This approach is left to 
State, regional and local governments and agencies. 

Second, an examination of the meaning of the terms "need" and "assess- 
ment" and of the definitions and characterizations given in the literature 
lead to the conclusion that "need" is an empty and unbounded term. It takes 
on meaning only in a specific context when someone or some group establishes 
an absolute (e.g., an income-related poverty line) or relative (e.g., the needs 
of group A conpared to those of B) criterion or standard for gauging need. 
These criteria are themselves value-laden and subject to philosophical and 
political debate and dispute. (See, for example, the provocative discussion of 
the wavering "poverty line" in U. S. DHEW, April 1976). 

Third, the methods proposed for the conduct of needs assessment are 
mary and borrowed from other places. They consist of heterogeneous mixed 
methods for (1) eliciting opinions or judgments of need from a variety of 
sources, (2) collecting data directly from the field (e.g., through a field 
survey), (3) inferring need from indirect indicators (e.g., social indicators), 
or (4) inferring need from the secoiidary analysis of existing data (e.g., 
utilization data already collected on the use of services in existing programs). 
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Experts tend to aqree that all thf- individual nv-thods have weaknesses. 
As a way to partially overcome these weaKnesses they urge the use ot multipl 
approaches but have never shown how any sinqle approach or combination of 
aoproaches can actually be used in priority-settinq. 

Fourth, there is no theory or organized analytics which lie behind the 
methods of needs assessment. They are instead, only tools for descriptive 
data collection r not for data analysis or interpretation. 

Fifth, self-conscious advocates of needs assessment realize that un- 
differentiated data on needs stand a small chance of influencing decisions 
and they therefore urge simplistic ' convergent models for data reduction 
and synthesis ar.d "a process" (undefined) for bringing nefH3s data to the 
attention of decision makers. 

Sixth, the tools and concepts of n^-eds assessment were compared with 
those of Planninq-Progranming and Budgeting which is directed toward the 
sliarfHa purposes of influencing resource allocation df-cisions. The com- 
parison revealed that needs assessment is generally "market" or "target 
group" oriented and conducted without explicit rwaard for resource, 
budgetary or funding constraints. PPB by contrast takes such constraints 
ds a point of departure and relics on an additional set of constraints in 
the form of articulated program and policy objectives. PPB carries with 
it tools for analysis. Needs assessment does !iot. 

Seventh, an examination reveals that the evidence on the actual 
utilization of the results of n«-eds assessments is spotty, scant, unevf-n 
and not encouraging. A very small percentaqe of needs assessments appears 
to have been uskJ in an actual decision-making setting and thf- evidence 
suggests that much of that use may be due to the utility of needs data 
for purposes of program justification and advocacy rather than analysis 
and systematic planning. ^r- 



Eighth, although surveys are sometimes promoted as the preferred 
approach to needs assessment, an examination of a statewide survey in 
Florida exposed several of the typical limitations and problems with 
this approach. Self -reporting on serious, subtle and sensitive psychic, 
social and physical problems is difficult and often unreliable. Sanpling, 
questionnaire design and item construction involve selection , and 
thus the exercise of values over what is and is not ijiportant. Sanple 
"representativeness" is hard to accomplish in real field surveys, especially 
those directed toward large-scale population groups subject to mobility 
and change in circumstances. Prestructured surveys are weak instruments 
for investigating the "causes" or sources of needs and problems and 
thus for formulating effective remedies. 

Ninth, while "priority lists" are appealing in principle they are of 
little help in formulating strategies for investing budget resources. 

Finally, a brief identification of the issues and operating context 
of a public agency suggested that there is often a merging of needs and 
wants (and indeed preferences); existing knowledge about the causes of and 
effective remedies for a large number of important social problems is par- <>. 
tial, bounded and fragmentary; and the needs assessment literature seems 
to rest on a set of arguable philosophical premises, including the notion 
that remedies for all social problems should be undertaken by government. 

In sum, the conceptual, methodological, and practical limits of proposed 
af^roaches to needs assessment suggest that most assessments will have only 
a small chance of inpacting on policy and resource allocation decisions. The 
next section provides some guidance for deciding whether to do a needs assess- 
ment on the few occasions when that activity might seem indicated. 
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X. ASSESSING THE NEED TO DO A NEEDS ASSESSMENT 

A. Why conduct a Needs Assessment? THaere are several alternative 
motives. Be clear on the intended purposes of a specific assessment. 

1. Advocacy ; Establishing estimates of the size of a social problem, 
usually numbers about the size of the population at risk or the target popu- 
lation of a proposed program , has a long and venerable history. Open any 
testimony given by government agencies before legislative appropriations 
coninittees whether at the Federal, state or local level and you will find 
numbers which purport to characterize the size of problems which proposed 
expenditures are to remedy. These numbers frequently magnify the size of 
a problem. It is conceivable that a case could be made for conducting a 
needs assessnent for the primary purpose of getting a more systematic fix 
on the size of a target population for use in advocating more resources for 
the target population or justifying those which are currently being expended. 
Since the art of advocacy does not have to meet rigorous analytical criteria 
and is usually carried on by groups outside a public agency, this motive 
for a needs assessment is not considered further . 

2. Formal Social Research ; Some advocates view the primary purpose 
of needs assessment as a vehicle for social research for its own sake, 
independent of its relevance for policy purposes. This justification is 
sometimes offered for research on social indicators and for social survey 
research. We recounted earlier, for example, that Scheff (1976) saw needs 
assessment as "an end in itself." Again, it is conceivable that a case 
could be made for supporting needs assessment as a basic or applied research 
activity or as one intended to further "tool" (methodological) development. 
This purpose for needs assessment is not a focal point of this paper. 



61 T^C 



3« Federal Requirements : Another primary motive for needs assessment 
may be to merely satisfy . Federal requirement. As we indicated earlier, 
however. Federal requirements are often vague, non-specific and admit of a 
number of alternative activities under that label. Assuming that a Federal 
requirement is intended to include analytical activity related to policy and 
budget development, questions and issues which should be addressed in de- 
ciding what to do are covered in the following section. 

4« Aid to Resource Allocation Decision Making t This rationale is 
claimed most widely in the literature as the purpose of needs assessment 
and is the one treated by this paper. 

B. Questions and Considerations ; If needs assessment is to be con- 
ducted for the purpose of aiding in the allocation of budgetary resources 
there is a set of basic questions which should be addressed before a decision 
is reached to sponsor and support a particular type of assessment. 

^' What is the specific issue or problem which a needs assessment is 
intended to address? This is probably the single most important question 
which can be raised about a proposed assessment . It is also the one which 
is most likely to be ignored, skirted or obscured. A detailed specifica- 
tion of the problem or issue which is to be addressed is a prerequisite 
to judging whether or not a needs assessment is appropriate. 
One approach to elaborating policy or budgetary problem(s) is to specify a 
set of questions which are to be answered. A structured way to do this is 
an "issue paper", a short, written statement which lays out in tentative 
terms: 

o The structure of the problem 

o Likely causes or sources of tne problem 
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o Known groups in the population affected by the problem 

o Objectives which might be met by public action desianed to 
remedy the problem 

o Criteria, such as measures of effectiveness, which might be 
enployed to indicate progress toward resolving the problem 

o An overview of programs, both public and private, which are 
already directed toward the problem 

o Estimated costs and inpacts of activities already underway and 
of new alternatives 

o An identification of significant constraints on reducing the 
problem 

o Major analytic or data problems which have to be handled if 
further analytic work is to proceed 

o A listing of the key steps of additional study and a-'-^-lysis 
%*iich need to be undertaken and an estimate of their cost and 
timing 

An "Issue paper" is an atteitpt to identify and describe the main features 
of a problem based on what is known or can be easily learned from existing 
sources. It is preliminary to more extensive analys. or data collection. 
A well-developed issue paper should indicate whether a given policy or 
budgetary issue or probl«u can be clarified by further analysis, better 
estimates of costs, a more refined understanding of the sources of a problem, 
a more vigorous search for alternatives, etc. Results of this "pre-analysis" 
should help indicate whether additional analytical steps ought to be a bene- 
fit-cost or cost-effectiveness study, an analysis or evaluation of existing 
programs, a needs assessment or some other form of structured analytical 
work. Details on the contents and formats of two alternative "issue papers" 
are provided in Hatry, et al (1976). A principal p urpose served by clari- 
fying and elaborating manor policy issues and probleirs before starting 
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dnalyticdl work and ddta collection is to ensure that tools art- sel*K:ted 
to fit ££obieiTis rdther_J:hd^^ vice~yer Sd . 

2. If ddditiondl analyticdl work (including an dSSf-ssment) is indicated r 
what tiinetable must be met? Studies and data collection usually take longer 
than exported. One precondition for the use of analysis and ne^Ss assessment 
is that results are completed in an organized form well before key decision 
points. 

3. If the collection of "needs" data is being considered, thes?' questions 
are appropriate: 

o What is wrong with your current estimates of need? Can they be 
inproved to a satisfactory level short of new data collection? 
Can you extrapolate or interpolate national data to vour area? 

0 How much precision in need estimates do you really need? If 
curr*?nt and expected resources will serve only a fraction of 
the likely target population (say 10-25%) what is the analytical 
value of knowing that a target population is 500,000 in size 
rather than 450,000 or 400,000? Probably little, if any. 

o What would you be giving up if you did not do the assessment? 
would an assessment make any perceptible difference in decision 
outcomes? 

o ;«Jhat are likely to be the full costs of conducting the assess- 
ment? How do these costs con^wre to your estimate of the payoff or 
benefits of having done the assessment? 

o How would you validate the results of an attempt at an assessment, 
especially deriving estimates of need from a survey? 

Since all available approaches to needs assessment have limitations dnd 

drawbacks, it would be worthwhile to consult thf^ critical literature on 

the methods under consideration in an attempt to determine the validity 

and reliability of results which will be generated. 

4. Explore the relevance and availability of needs estimates 
already available in other locales, especially in comparable settings. 
Since other jurisdictions are being required by Federal programs to con- 
duct needs assessments, the likelihood is high that thf>y can be located 



by contacting neighboring jurisdictions. This may be especially helpful if 
it can be established that a neeas assessment in an area of state interest 
has already been conducted on a population group similar in demographic 
composition, urban-rural mix and other significant factors. If appropriate 
estimates of the needs of comparable populations can be located, findings 
may be roughly transferable through extrapolations and adjustments in demo- 
graphic data and associated findings. 

Similarly, social indicator studies, surveys ana policy analyses abound. 
They can be accessed through conventional library and document search 
procedures. In some instances broad based searches of existing polling 
data have already been completed. The Gerontology Program of the University 
ot Nebraska, for example, conducted an examination of national opinion 
polls in the U.S. for the purpose of inventorying anu extracting data 
which related to the needs, attitudes and behaviors of the aging. Their 
report (1976) would be a useful point of departure for a new needs 
assessment in the area of aging services. Lewis (lb>73) did a careful 
and ccHiprehensive analytical job of examining the needs, costs, benefits and 
alternatives to day care. The Policy Arialysis_Source Book (IbVb) abstracts 
and cross-classifies vhousands of existing policy studies. A little research 
on existin^j studies, analyses, surveys, indicator studies, and needs 
assessments may save a considerable amount of time, nergy and cost. 

5. Attempt to estimate the risk which the results of a needs assess- 
nient might pose for the sponsoring organization. Though there are a number 
of potential factors which might be considered, Murrell (197b) suggests two: 

o To what extent are 'maintenance inputs" of the organization 
stable and safe? Ihese include funding, clientele, and the 
support of higher organizational levels. When these factors 
are safe and secure the organization will be more tolerant of 
the possible threat of new information. If they are unstable 
the organization will be less tolerant of risk and the poten- 
tial threat of new information. 
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o To what extent is th^^' organization oriented to growth and change? 
If the ideology of an organization is oriented to a steady state, 
the chances for use of new information will be lower than if /tt 
is oriented to growth and change. 

6. If an assessment or an analysis is conducted, maintain regular 
involvement of appropriate agency program staff. This will ensure that 
knowledgeable individuals are involved in the design of the study 

and acquainted with the strengths and weaknesses of tli? approach as results, 
are made available to agency staff. 

7. Explicitly consider the potential utility for policy purposes of a 
problem-oriented and problem specific issue or policy analysis as a major 
alternative to or method of neeas assessment. Good analytical work, even if 
crude, using existing data and secondary analysis, and performed on a small 
scale, will illuminate actuax policy choices better ±an extensive data 
collection. 
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